Nov 02 15:22:58 devstack cinder-volume[75093]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 15:22:58 devstack cinder-volume[75093]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 15:22:58 devstack cinder-volume[75093]: we strongly recommend against using it for new projects. Nov 02 15:22:58 devstack cinder-volume[75093]: If you are already using Eventlet, we recommend migrating to a different Nov 02 15:22:58 devstack cinder-volume[75093]: framework. For more detail see Nov 02 15:22:58 devstack cinder-volume[75093]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 15:22:58 devstack cinder-volume[75093]: import eventlet # noqa Nov 02 15:23:00 devstack cinder-volume[75093]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75093) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 15:23:00 devstack cinder-volume[75093]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75093) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 15:23:00 devstack cinder-volume[75093]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75093) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 15:23:01 devstack cinder-volume[75093]: INFO dbcounter [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] Registered counter for database cinder Nov 02 15:23:01 devstack cinder-volume[75093]: DEBUG oslo_db.sqlalchemy.engines [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75093) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 15:23:02 devstack cinder-volume[75093]: DEBUG dbcounter [-] [75093] Writer thread running {{(pid=75093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 15:23:02 devstack cinder-volume[75093]: INFO cinder.rpc [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 15:23:02 devstack cinder-volume[75093]: INFO cinder.rpc [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 15:23:02 devstack cinder-volume[75093]: DEBUG oslo_db.sqlalchemy.engines [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75093) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 15:23:02 devstack cinder-volume[75093]: INFO cinder.volume.manager [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] Determined volume DB was empty at startup. Nov 02 15:23:02 devstack cinder-volume[75093]: DEBUG cinder.volume.manager [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75093) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 15:23:02 devstack cinder-volume[75093]: INFO cinder.volume.manager [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 02 15:23:02 devstack cinder-volume[75093]: WARNING stevedore.named [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 15:23:02 devstack cinder-volume[75093]: WARNING castellan.key_manager [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 15:23:02 devstack cinder-volume[75093]: WARNING cinder.keymgr.conf_key_mgr [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 15:23:02 devstack cinder-volume[75093]: DEBUG cinder.volume.drivers.lvm [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75093) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 02 15:23:02 devstack cinder-volume[75093]: DEBUG oslo_concurrency.processutils [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:23:02 devstack cinder-volume[75093]: DEBUG oslo_concurrency.processutils [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] CMD "cinder-rtstool verify" returned: 0 in 0.439s {{(pid=75093) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:23:02 devstack cinder-volume[75093]: DEBUG oslo_db.sqlalchemy.engines [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75093) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 15:23:02 devstack cinder-volume[75093]: INFO cinder.rpc [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 02 15:23:02 devstack cinder-volume[75093]: INFO cinder.rpc [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 02 15:23:02 devstack cinder-volume[75093]: WARNING stevedore.named [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 15:23:02 devstack cinder-volume[75093]: WARNING castellan.key_manager [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 15:23:02 devstack cinder-volume[75093]: INFO cinder.volume.manager [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_db.sqlalchemy.engines [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75093) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 15:23:03 devstack cinder-volume[75093]: INFO oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] Starting 1 workers Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] Started child 75231 {{(pid=75093) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] Full set of CONF: {{(pid=75093) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] ******************************************************************************** {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] Configuration options gathered from: {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] ================================================================================ {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] allow_availability_zone_fallback = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75231]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] allow_compression_on_image_upload = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] allowed_direct_url_schemes = [] {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] api_rate_limit = True {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] auth_strategy = keystone {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] az_cache_duration = 3600 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_availability_zone = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_host = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_name = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_stats_polling_interval = 60 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backup_api_class = cinder.backup.api.API {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backup_name_template = backup-%s {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backup_use_same_host = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backup_use_temp_snapshot = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] chap_password = **** {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] chap_username = {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cinder_internal_tenant_project_id = a632681fc076490498c0dbe472085959 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cinder_internal_tenant_user_id = 2f3a16bcc5be447782588022a3a84603 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cloned_volume_same_az = True {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cluster = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] compression_format = gzip {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] compute_api_class = cinder.compute.nova.API {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] config_dir = [] {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] config_source = [] {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] control_exchange = openstack {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] debug = True {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] default_availability_zone = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] default_group_type = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] default_volume_type = lvmdriver-1 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] disk_geometry = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] driver_client_cert = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] driver_client_cert_key = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] driver_data_namespace = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] driver_ssl_cert_path = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] driver_ssl_cert_verify = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] driver_use_ssl = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] enable_force_upload = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] enable_new_services = True {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] enable_unsupported_driver = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] enforce_multipath_for_image_xfer = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] filter_function = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] glance_api_insecure = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] glance_api_servers = ['http://192.168.122.107/image'] {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] glance_api_ssl_compression = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] glance_ca_certificates_file = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] glance_catalog_info = image:glance:publicURL {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] glance_certfile = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] glance_keyfile = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] glance_num_retries = 3 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] glance_request_timeout = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] goodness_function = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] graceful_shutdown_timeout = 5 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] group_api_class = cinder.group.api.API {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] host = devstack {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] image_compress_on_upload = True {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] image_conversion_address_space_limit = 1 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] image_conversion_cpu_limit = 60 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] image_conversion_disable = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] image_introspection_address_space_limit = 1 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] image_introspection_cpu_limit = 60 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] image_upload_use_cinder_backend = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] image_upload_use_internal_tenant = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] image_volume_cache_enabled = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] image_volume_cache_max_count = 0 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] image_volume_cache_max_size_gb = 0 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] init_host_max_objects_retrieval = 0 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] instance_format = [instance: %(uuid)s] {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] iscsi_target_flags = {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] iscsi_write_cache = on {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] iser_helper = tgtadm {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] iser_ip_address = 192.168.122.107 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] iser_port = 3260 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] log_color = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] log_config_append = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] log_dir = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] log_file = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] log_options = True {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] log_rotate_interval = 1 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] log_rotate_interval_type = days {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] log_rotation_type = none {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] max_age = 0 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] max_logfile_count = 30 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] max_logfile_size_mb = 200 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75231]: INFO cinder.volume.manager [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] max_over_subscription_ratio = 20.0 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] message_reap_interval = 86400 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] message_ttl = 2592000 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] migration_create_volume_timeout_secs = 300 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] monkey_patch = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] monkey_patch_modules = [] {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] my_ip = 192.168.122.107 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] no_snapshot_gb_quota = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] num_iser_scan_tries = 3 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] num_shell_tries = 3 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] num_volume_device_scan_tries = 3 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] nvmeof_conn_info_version = 1 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] nvmet_ns_id = 10 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] nvmet_port_id = 1 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] osapi_max_limit = 1000 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] osapi_volume_ext_list = [] {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] osapi_volume_listen_port = 8776 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] osapi_volume_use_ssl = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] osapi_volume_workers = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] per_volume_size_limit = -1 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] periodic_fuzzy_delay = 60 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] periodic_interval = 60 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] public_endpoint = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] publish_errors = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] quota_backup_gigabytes = 1000 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] quota_backups = 10 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] quota_gigabytes = 1000 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] quota_groups = 10 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] quota_snapshots = 10 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] quota_volumes = 10 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] rate_limit_burst = 0 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] rate_limit_except_level = CRITICAL {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] rate_limit_interval = 0 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] reinit_driver_count = 3 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] replication_device = **** {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] report_discard_supported = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] report_interval = 120 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] reservation_clean_interval = 86400 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] reservation_expire = 86400 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] reserved_image_namespaces = [] {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] reserved_percentage = 0 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] rpc_response_timeout = 120 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] run_external_periodic_tasks = True {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] scst_target_driver = iscsi {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] scst_target_iqn_name = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] service_down_time = 720 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] shell_completion = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:23:03 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] snapshot_name_template = snapshot-%s {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] snapshot_same_host = True {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] split_loggers = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] state_path = /opt/stack/data/cinder {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] storage_availability_zone = nova {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] storage_protocol = iSCSI {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] syslog_log_facility = LOG_USER {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:23:03 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] target_helper = lioadm {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] target_ip_address = 192.168.122.107 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] target_port = 3260 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] target_protocol = iscsi {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] target_secondary_ip_addresses = [] {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] trace_flags = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] transport_url = **** {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] until_refresh = 0 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] use_chap_auth = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] use_default_quota_class = True {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] use_journal = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] use_json = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] use_multipath_for_image_xfer = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] use_stderr = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] use_syslog = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] verify_glance_signatures = enabled {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] volume_api_class = cinder.volume.api.API {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] volume_backend_name = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] volume_clear = zero {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] volume_clear_ionice = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] volume_clear_size = 0 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] volume_copy_bps_limit = 0 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] volume_dd_blocksize = 1M {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] volume_name_template = volume-%s {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] volume_service_inithost_offload = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] volume_usage_audit_period = month {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] zoning_mode = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_concurrency.disable_process_locking = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.auth_section = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.auth_type = password {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.auth_version = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.cache = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.certfile = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.include_service_catalog = True {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.insecure = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.interface = public {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.keyfile = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.memcache_password = **** {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.memcache_username = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.region_name = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.service_type = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.107/identity {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.backend = dogpile.cache.null {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.backend_argument = **** {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.backend_expiration_time = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.config_prefix = cache.oslo {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.debug_cache_backend = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.enable_retry_client = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.enable_socket_keepalive = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.enabled = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.expiration_time = 600 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.hashclient_retry_attempts = 2 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.memcache_dead_retry = 300 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.memcache_pool_maxsize = 10 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.memcache_sasl_enabled = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.password = **** {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.proxies = [] {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.redis_db = 0 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.redis_server = localhost:6379 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.retry_attempts = 2 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.retry_delay = 0.0 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.socket_keepalive_count = 1 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.socket_keepalive_idle = 1 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.socket_keepalive_interval = 1 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.socket_timeout = 1.0 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.tls_allowed_ciphers = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.tls_cafile = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.tls_certfile = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.tls_enabled = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.tls_keyfile = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cache.username = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] coordination.backend_url = **** {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] database.asyncio_connection = **** {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] database.asyncio_slave_connection = **** {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] database.backend = sqlalchemy {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] database.connection = **** {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] database.connection_debug = 0 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] database.connection_parameters = {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] database.connection_recycle_time = 3600 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] database.connection_trace = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] database.db_inc_retry_interval = True {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] database.db_max_retries = 20 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] database.db_max_retry_interval = 10 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] database.db_retry_interval = 1 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] database.max_overflow = 50 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] database.max_pool_size = 5 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] database.max_retries = 10 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] database.mysql_wsrep_sync_wait = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] database.pool_timeout = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] database.retry_interval = 10 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] database.slave_connection = **** {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] database.sqlite_synchronous = True {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] database.synchronous_reader = True {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] database.use_db_reconnect = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack sudo[75235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_tracing.insecure = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] profiler.connection_string = messaging:// {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] profiler.enabled = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] profiler.es_doc_type = notification {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] profiler.es_scroll_size = 10000 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] profiler.es_scroll_time = 2m {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] profiler.filter_error_trace = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] profiler.hmac_keys = **** {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack sudo[75235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] profiler.sentinel_service_name = mymaster {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] profiler.socket_timeout = 0.1 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] profiler.trace_requests = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] profiler.trace_sqlalchemy = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] profiler_jaeger.process_tags = {} {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] profiler_jaeger.service_name_prefix = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] profiler_otlp.service_name_prefix = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_policy.enforce_new_defaults = True {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_policy.policy_default_rule = default {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_policy.policy_file = policy.yaml {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] privsep_osbrick.group = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] privsep_osbrick.helper_command = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] privsep_osbrick.user = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cinder_sys_admin.group = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cinder_sys_admin.helper_command = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] cinder_sys_admin.user = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] service_user.auth_section = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] service_user.auth_type = password {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] service_user.cafile = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] service_user.certfile = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] service_user.collect_timing = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] service_user.insecure = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] service_user.keyfile = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] service_user.send_service_user_token = True {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] service_user.split_loggers = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] service_user.timeout = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] service_user.tls_ciphers = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] service_user.tls_min_version = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] glance.auth_section = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] glance.auth_type = password {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] glance.certfile = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] glance.collect_timing = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] glance.insecure = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] glance.keyfile = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] glance.region_name = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] glance.split_loggers = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] glance.timeout = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] glance.tls_ciphers = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] glance.tls_min_version = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.backend_availability_zone = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.chap_password = **** {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.chap_username = {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.disk_geometry = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.driver_client_cert = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.driver_client_cert_key = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.driver_data_namespace = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.driver_use_ssl = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.extra_capabilities = {} {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.filter_function = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.goodness_function = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.iscsi_target_flags = {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.iscsi_write_cache = on {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.iser_helper = tgtadm {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.iser_ip_address = 192.168.122.107 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.iser_port = 3260 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.lvm_share_target = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.lvm_type = auto {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.num_shell_tries = 3 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.replication_device = **** {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.report_discard_supported = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.reserved_percentage = 0 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.target_helper = tgtadm {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.target_ip_address = 192.168.122.107 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.target_port = 3260 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.target_protocol = iscsi {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.trace_flags = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.unique_fqdn_network = True {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.use_chap_auth = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.volume_backend_name = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.volume_clear = zero {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.volume_clear_ionice = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.volume_clear_size = 0 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_reports.file_event_handler = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_reports.log_dir = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.backend_host = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.chap_password = **** {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.chap_username = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.disk_geometry = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.driver_client_cert = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.extra_capabilities = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.filter_function = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.goodness_function = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.iser_helper = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.iser_ip_address = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.iser_port = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.lvm_share_target = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.lvm_type = auto {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.num_shell_tries = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.replication_device = **** {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.report_discard_supported = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.reserved_percentage = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.scst_target_driver = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.storage_protocol = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.target_helper = lioadm {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.target_ip_address = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.target_port = 3260 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.trace_flags = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.use_chap_auth = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.volume_clear = zero {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.volume_clear_size = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] lvmdriver-1.volumes_dir = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.ssl = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_notifications.driver = [] {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_notifications.retry = -1 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] key_manager.fixed_key = **** {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] barbican.barbican_api_version = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] barbican.barbican_endpoint = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] barbican.barbican_endpoint_type = public {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] barbican.barbican_region_name = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] barbican.cafile = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] barbican.certfile = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] barbican.collect_timing = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] barbican.insecure = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] barbican.keyfile = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] barbican.number_of_retries = 60 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] barbican.retry_delay = 1 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] barbican.send_service_user_token = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] barbican.split_loggers = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] barbican.timeout = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] barbican.tls_ciphers = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] barbican.tls_min_version = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] barbican.verify_ssl = True {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] barbican.verify_ssl_path = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] barbican_service_user.auth_section = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] barbican_service_user.auth_type = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] barbican_service_user.cafile = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] barbican_service_user.certfile = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] barbican_service_user.collect_timing = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] barbican_service_user.insecure = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] barbican_service_user.keyfile = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] barbican_service_user.split_loggers = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] barbican_service_user.timeout = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] barbican_service_user.tls_ciphers = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] barbican_service_user.tls_min_version = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] vault.approle_role_id = **** {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] vault.approle_secret_id = **** {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] vault.auth_method = approle {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] vault.auth_path = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] vault.kv_mountpoint = secret {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] vault.kv_path = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] vault.kv_version = 2 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] vault.namespace = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] vault.root_token_id = **** {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] vault.ssl_ca_crt_file = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] vault.timeout = 60.0 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] vault.token_file = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] vault.token_role = None {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] vault.use_ssl = False {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:23:03 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] ******************************************************************************** {{(pid=75093) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 15:23:03 devstack sudo[75235]: pam_unix(sudo:session): session closed for user root Nov 02 15:23:03 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.355s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:23:03 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:23:03 devstack sudo[75242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 15:23:03 devstack sudo[75242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:23:03 devstack sudo[75242]: pam_unix(sudo:session): session closed for user root Nov 02 15:23:03 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.261s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:23:03 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 15:23:03 devstack cinder-volume[75231]: INFO cinder.brick.local_dev.lvm [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 02 15:23:03 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:23:03 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:23:03 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:23:03 devstack sudo[75246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 15:23:03 devstack sudo[75246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:23:04 devstack sudo[75246]: pam_unix(sudo:session): session closed for user root Nov 02 15:23:04 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:23:04 devstack cinder-volume[75231]: DEBUG cinder.brick.local_dev.lvm [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75231) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 02 15:23:04 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:23:04 devstack sudo[75274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 15:23:04 devstack sudo[75274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:23:04 devstack sudo[75274]: pam_unix(sudo:session): session closed for user root Nov 02 15:23:04 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.584s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:23:04 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:23:04 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:23:04 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:23:04 devstack sudo[75492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 15:23:04 devstack sudo[75492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:23:05 devstack sudo[75492]: pam_unix(sudo:session): session closed for user root Nov 02 15:23:05 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:23:05 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:23:05 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:23:05 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:23:05 devstack sudo[75581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 02 15:23:05 devstack sudo[75581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:23:05 devstack sudo[75581]: pam_unix(sudo:session): session closed for user root Nov 02 15:23:05 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.251s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:23:05 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:23:05 devstack sudo[75674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 15:23:05 devstack sudo[75674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:23:05 devstack sudo[75674]: pam_unix(sudo:session): session closed for user root Nov 02 15:23:05 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:23:05 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:23:05 devstack sudo[75758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 15:23:05 devstack sudo[75758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:23:05 devstack sudo[75758]: pam_unix(sudo:session): session closed for user root Nov 02 15:23:05 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.310s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:23:05 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:23:05 devstack sudo[75851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 15:23:05 devstack sudo[75851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:23:06 devstack sudo[75851]: pam_unix(sudo:session): session closed for user root Nov 02 15:23:06 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:23:06 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:23:06 devstack sudo[75854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 15:23:06 devstack sudo[75854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:23:06 devstack sudo[75854]: pam_unix(sudo:session): session closed for user root Nov 02 15:23:06 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.333s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:23:06 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:23:06 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:23:06 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:23:06 devstack sudo[75939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 15:23:06 devstack sudo[75939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:23:06 devstack sudo[75939]: pam_unix(sudo:session): session closed for user root Nov 02 15:23:06 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.277s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:23:06 devstack cinder-volume[75231]: INFO cinder.volume.drivers.lvm [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 02 15:23:06 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:23:06 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:23:06 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:23:06 devstack sudo[75948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 15:23:06 devstack sudo[75948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:23:07 devstack sudo[75948]: pam_unix(sudo:session): session closed for user root Nov 02 15:23:07 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.335s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:23:07 devstack cinder-volume[75231]: DEBUG cinder.volume.drivers.lvm [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Updating volume stats {{(pid=75231) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 15:23:07 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:23:07 devstack sudo[76038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 15:23:07 devstack sudo[76038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:23:07 devstack sudo[76038]: pam_unix(sudo:session): session closed for user root Nov 02 15:23:07 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:23:07 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:23:07 devstack sudo[76041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 15:23:07 devstack sudo[76041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:23:07 devstack sudo[76041]: pam_unix(sudo:session): session closed for user root Nov 02 15:23:07 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:23:07 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:23:07 devstack sudo[76044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 15:23:07 devstack sudo[76044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:23:07 devstack sudo[76044]: pam_unix(sudo:session): session closed for user root Nov 02 15:23:07 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:23:07 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:23:07 devstack sudo[76047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 15:23:07 devstack sudo[76047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:23:08 devstack sudo[76047]: pam_unix(sudo:session): session closed for user root Nov 02 15:23:08 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:23:08 devstack cinder-volume[75231]: INFO cinder.volume.driver [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Driver hasn't implemented _init_vendor_properties() Nov 02 15:23:08 devstack cinder-volume[75231]: DEBUG cinder.volume.driver [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75231) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 15:23:08 devstack cinder-volume[75231]: DEBUG oslo_db.sqlalchemy.engines [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75231) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 15:23:08 devstack cinder-volume[75231]: DEBUG dbcounter [-] [75231] Writer thread running {{(pid=75231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 15:23:08 devstack cinder-volume[75231]: DEBUG cinder.db.api [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Building query based on filter {{(pid=75231) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 02 15:23:08 devstack cinder-volume[75231]: DEBUG cinder.image.image_utils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75231) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 02 15:23:08 devstack cinder-volume[75231]: INFO cinder.keymgr.migration [None req-1c3774a8-27ca-4eca-b741-baec33c4eb4a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 15:23:08 devstack cinder-volume[75231]: DEBUG cinder.volume.drivers.lvm [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Updating volume stats {{(pid=75231) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 15:23:08 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:23:08 devstack sudo[76051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 15:23:08 devstack sudo[76051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:23:08 devstack sudo[76051]: pam_unix(sudo:session): session closed for user root Nov 02 15:23:08 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:23:08 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:23:08 devstack sudo[76054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 15:23:08 devstack sudo[76054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:23:08 devstack sudo[76054]: pam_unix(sudo:session): session closed for user root Nov 02 15:23:08 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.237s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:23:08 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:23:08 devstack sudo[76057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 15:23:08 devstack sudo[76057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:23:09 devstack sudo[76057]: pam_unix(sudo:session): session closed for user root Nov 02 15:23:09 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:23:09 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:23:09 devstack sudo[76060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 15:23:09 devstack sudo[76060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:23:09 devstack sudo[76060]: pam_unix(sudo:session): session closed for user root Nov 02 15:23:09 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.236s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:23:09 devstack cinder-volume[75231]: DEBUG cinder.manager [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Notifying Schedulers of capabilities ... {{(pid=75231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:23:09 devstack cinder-volume[75231]: INFO cinder.volume.manager [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Driver initialization completed successfully. Nov 02 15:23:09 devstack cinder-volume[75231]: INFO cinder.manager [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Initiating service 2 cleanup Nov 02 15:23:09 devstack cinder-volume[75231]: INFO cinder.manager [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Service 2 cleanup completed. Nov 02 15:23:09 devstack cinder-volume[75231]: DEBUG cinder.service [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Creating RPC server for service cinder-volume {{(pid=75231) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 15:23:09 devstack cinder-volume[75231]: DEBUG cinder.service [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75231) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 15:23:09 devstack cinder-volume[75231]: INFO cinder.volume.manager [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 02 15:23:09 devstack cinder-volume[75231]: DEBUG cinder.volume.drivers.lvm [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Updating volume stats {{(pid=75231) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 15:23:09 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:23:09 devstack sudo[76065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 15:23:09 devstack sudo[76065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:23:09 devstack sudo[76065]: pam_unix(sudo:session): session closed for user root Nov 02 15:23:09 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:23:09 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:23:09 devstack sudo[76068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 15:23:09 devstack sudo[76068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:23:10 devstack sudo[76068]: pam_unix(sudo:session): session closed for user root Nov 02 15:23:10 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:23:10 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:23:10 devstack sudo[76071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 15:23:10 devstack sudo[76071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:23:10 devstack sudo[76071]: pam_unix(sudo:session): session closed for user root Nov 02 15:23:10 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:23:10 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:23:10 devstack sudo[76074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 15:23:10 devstack sudo[76074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:23:10 devstack sudo[76074]: pam_unix(sudo:session): session closed for user root Nov 02 15:23:10 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:23:10 devstack cinder-volume[75231]: INFO cinder.volume.manager [None req-4c9e3f1b-0f42-48cb-b40e-b44be011adbf None None] Driver post RPC initialization completed successfully. Nov 02 15:23:13 devstack cinder-volume[75093]: DEBUG dbcounter [-] [75093] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75093) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:23:20 devstack cinder-volume[75231]: DEBUG dbcounter [-] [75231] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:23:20 devstack cinder-volume[75231]: DEBUG dbcounter [-] [75231] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:23:22 devstack cinder-volume[75231]: DEBUG oslo_service.periodic_task [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] Running periodic task VolumeManager._thread_info {{(pid=75231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:23:22 devstack cinder-volume[75231]: DEBUG cinder.volume.manager [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] thread count: 6 {{(pid=75231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 15:23:22 devstack cinder-volume[75231]: DEBUG cinder.volume.manager [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] thread info: [<_MainThread(MainThread, started 128760532926592)>, , , , , ] {{(pid=75231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 15:24:22 devstack cinder-volume[75231]: DEBUG oslo_service.periodic_task [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:24:22 devstack cinder-volume[75231]: DEBUG cinder.volume.drivers.lvm [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] Updating volume stats {{(pid=75231) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 15:24:22 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:24:22 devstack sudo[78559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 15:24:22 devstack sudo[78559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:24:22 devstack sudo[78559]: pam_unix(sudo:session): session closed for user root Nov 02 15:24:22 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:24:22 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:24:22 devstack sudo[78562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 15:24:22 devstack sudo[78562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:24:23 devstack sudo[78562]: pam_unix(sudo:session): session closed for user root Nov 02 15:24:23 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:24:23 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:24:23 devstack sudo[78565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 15:24:23 devstack sudo[78565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:24:23 devstack sudo[78565]: pam_unix(sudo:session): session closed for user root Nov 02 15:24:23 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:24:23 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:24:23 devstack sudo[78568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 15:24:23 devstack sudo[78568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:24:23 devstack sudo[78568]: pam_unix(sudo:session): session closed for user root Nov 02 15:24:23 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:24:23 devstack cinder-volume[75231]: DEBUG cinder.manager [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] Notifying Schedulers of capabilities ... {{(pid=75231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:24:23 devstack cinder-volume[75231]: DEBUG oslo_service.periodic_task [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] Running periodic task VolumeManager._thread_info {{(pid=75231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:24:23 devstack cinder-volume[75231]: DEBUG cinder.volume.manager [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] thread count: 6 {{(pid=75231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 15:24:23 devstack cinder-volume[75231]: DEBUG cinder.volume.manager [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] thread info: [<_MainThread(MainThread, started 128760532926592)>, , , , , ] {{(pid=75231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 15:25:20 devstack cinder-volume[75231]: DEBUG dbcounter [-] [75231] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:25:22 devstack cinder-volume[75231]: DEBUG oslo_service.periodic_task [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:25:22 devstack cinder-volume[75231]: DEBUG cinder.volume.drivers.lvm [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] Updating volume stats {{(pid=75231) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 15:25:22 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:25:22 devstack sudo[81882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 15:25:22 devstack sudo[81882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:25:22 devstack sudo[81882]: pam_unix(sudo:session): session closed for user root Nov 02 15:25:22 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:25:22 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:25:22 devstack sudo[81987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 15:25:22 devstack sudo[81987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:25:23 devstack sudo[81987]: pam_unix(sudo:session): session closed for user root Nov 02 15:25:23 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:25:23 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:25:23 devstack sudo[81991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 15:25:23 devstack sudo[81991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:25:23 devstack sudo[81991]: pam_unix(sudo:session): session closed for user root Nov 02 15:25:23 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:25:23 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:25:23 devstack sudo[81994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 15:25:23 devstack sudo[81994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:25:23 devstack sudo[81994]: pam_unix(sudo:session): session closed for user root Nov 02 15:25:23 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:25:23 devstack cinder-volume[75231]: DEBUG cinder.manager [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] Notifying Schedulers of capabilities ... {{(pid=75231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:25:23 devstack cinder-volume[75231]: DEBUG oslo_service.periodic_task [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] Running periodic task VolumeManager._thread_info {{(pid=75231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:25:23 devstack cinder-volume[75231]: DEBUG cinder.volume.manager [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] thread count: 6 {{(pid=75231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 15:25:23 devstack cinder-volume[75231]: DEBUG cinder.volume.manager [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] thread info: [<_MainThread(MainThread, started 128760532926592)>, , , , , ] {{(pid=75231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 15:26:22 devstack cinder-volume[75231]: DEBUG oslo_service.periodic_task [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:26:22 devstack cinder-volume[75231]: DEBUG cinder.volume.drivers.lvm [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] Updating volume stats {{(pid=75231) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 15:26:22 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:26:22 devstack sudo[84116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 15:26:22 devstack sudo[84116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:26:22 devstack sudo[84116]: pam_unix(sudo:session): session closed for user root Nov 02 15:26:22 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:26:22 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:26:22 devstack sudo[84122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 15:26:22 devstack sudo[84122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:26:23 devstack sudo[84122]: pam_unix(sudo:session): session closed for user root Nov 02 15:26:23 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:26:23 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:26:23 devstack sudo[84125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 15:26:23 devstack sudo[84125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:26:23 devstack sudo[84125]: pam_unix(sudo:session): session closed for user root Nov 02 15:26:23 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:26:23 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:26:23 devstack sudo[84129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 15:26:23 devstack sudo[84129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:26:23 devstack sudo[84129]: pam_unix(sudo:session): session closed for user root Nov 02 15:26:23 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:26:23 devstack cinder-volume[75231]: DEBUG cinder.manager [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] Notifying Schedulers of capabilities ... {{(pid=75231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:27:20 devstack cinder-volume[75231]: DEBUG dbcounter [-] [75231] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75231) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:27:22 devstack cinder-volume[75231]: DEBUG oslo_service.periodic_task [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:27:22 devstack cinder-volume[75231]: DEBUG cinder.volume.drivers.lvm [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] Updating volume stats {{(pid=75231) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 02 15:27:22 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:27:22 devstack sudo[85239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 02 15:27:22 devstack sudo[85239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:27:22 devstack sudo[85239]: pam_unix(sudo:session): session closed for user root Nov 02 15:27:22 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:27:22 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:27:22 devstack sudo[85256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 15:27:22 devstack sudo[85256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:27:23 devstack sudo[85256]: pam_unix(sudo:session): session closed for user root Nov 02 15:27:23 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:27:23 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:27:23 devstack sudo[85268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 02 15:27:23 devstack sudo[85268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:27:23 devstack sudo[85268]: pam_unix(sudo:session): session closed for user root Nov 02 15:27:23 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:27:23 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:27:23 devstack sudo[85271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 02 15:27:23 devstack sudo[85271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:27:23 devstack sudo[85271]: pam_unix(sudo:session): session closed for user root Nov 02 15:27:23 devstack cinder-volume[75231]: DEBUG oslo_concurrency.processutils [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75231) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:27:23 devstack cinder-volume[75231]: DEBUG cinder.manager [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] Notifying Schedulers of capabilities ... {{(pid=75231) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:27:23 devstack cinder-volume[75231]: DEBUG oslo_service.periodic_task [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] Running periodic task VolumeManager._thread_info {{(pid=75231) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:27:23 devstack cinder-volume[75231]: DEBUG cinder.volume.manager [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] thread count: 6 {{(pid=75231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 15:27:23 devstack cinder-volume[75231]: DEBUG cinder.volume.manager [None req-bd0e8c10-af91-4146-9acc-14ab0179ff23 None None] thread info: [<_MainThread(MainThread, started 128760532926592)>, , , , , ] {{(pid=75231) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 15:27:34 devstack cinder-volume[75093]: INFO oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] Caught SIGTERM, stopping children Nov 02 15:27:34 devstack cinder-volume[75093]: DEBUG oslo_concurrency.lockutils [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] Acquiring lock "singleton_lock" {{(pid=75093) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 15:27:34 devstack cinder-volume[75093]: DEBUG oslo_concurrency.lockutils [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] Acquired lock "singleton_lock" {{(pid=75093) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 15:27:34 devstack cinder-volume[75093]: DEBUG oslo_concurrency.lockutils [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] Releasing lock "singleton_lock" {{(pid=75093) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 15:27:34 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] Stop services. {{(pid=75093) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 02 15:27:34 devstack cinder-volume[75093]: DEBUG oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] Killing children. {{(pid=75093) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 02 15:27:34 devstack cinder-volume[75093]: INFO oslo_service.backend._eventlet.service [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] Waiting on 1 children to exit Nov 02 15:27:39 devstack cinder-volume[75231]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Nov 02 15:27:39 devstack cinder-volume[85644]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 15:27:39 devstack cinder-volume[85644]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 15:27:39 devstack cinder-volume[85644]: we strongly recommend against using it for new projects. Nov 02 15:27:39 devstack cinder-volume[85644]: If you are already using Eventlet, we recommend migrating to a different Nov 02 15:27:39 devstack cinder-volume[85644]: framework. For more detail see Nov 02 15:27:39 devstack cinder-volume[85644]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 15:27:39 devstack cinder-volume[85644]: import eventlet # noqa Nov 02 15:27:42 devstack cinder-volume[85644]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85644) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 15:27:42 devstack cinder-volume[85644]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85644) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 15:27:42 devstack cinder-volume[85644]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85644) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 15:27:42 devstack cinder-volume[85644]: INFO dbcounter [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] Registered counter for database cinder Nov 02 15:27:42 devstack cinder-volume[85644]: DEBUG oslo_db.sqlalchemy.engines [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85644) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG dbcounter [-] [85644] Writer thread running {{(pid=85644) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 15:27:43 devstack cinder-volume[85644]: INFO cinder.rpc [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 15:27:43 devstack cinder-volume[85644]: INFO cinder.rpc [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_db.sqlalchemy.engines [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85644) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 15:27:43 devstack cinder-volume[85644]: INFO cinder.volume.manager [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] Determined volume DB was empty at startup. Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG cinder.volume.manager [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85644) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 15:27:43 devstack cinder-volume[85644]: INFO cinder.volume.manager [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 02 15:27:43 devstack cinder-volume[85644]: WARNING stevedore.named [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 15:27:43 devstack cinder-volume[85644]: WARNING castellan.key_manager [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 15:27:43 devstack cinder-volume[85644]: WARNING cinder.keymgr.conf_key_mgr [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 15:27:43 devstack cinder-volume[85644]: INFO cinder.volume.manager [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_db.sqlalchemy.engines [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85644) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 15:27:43 devstack cinder-volume[85644]: INFO oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] Starting 1 workers Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] Started child 85898 {{(pid=85644) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] Full set of CONF: {{(pid=85644) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] ******************************************************************************** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] Configuration options gathered from: {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] ================================================================================ {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] allow_availability_zone_fallback = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] allow_compression_on_image_upload = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] allowed_direct_url_schemes = [] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] api_rate_limit = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] auth_strategy = keystone {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_availability_zone = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_host = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_name = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_stats_polling_interval = 60 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backup_api_class = cinder.backup.api.API {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backup_name_template = backup-%s {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backup_use_same_host = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backup_use_temp_snapshot = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] chap_password = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] chap_username = {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cinder_internal_tenant_project_id = a632681fc076490498c0dbe472085959 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cinder_internal_tenant_user_id = 2f3a16bcc5be447782588022a3a84603 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cluster = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] compression_format = gzip {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] compute_api_class = cinder.compute.nova.API {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] config_dir = [] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] config_source = [] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] control_exchange = openstack {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] debug = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] default_availability_zone = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] default_group_type = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] default_volume_type = QuobyteHD {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] disk_geometry = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] driver_client_cert = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] driver_client_cert_key = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] driver_data_namespace = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] driver_ssl_cert_path = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] driver_ssl_cert_verify = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] driver_use_ssl = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] enable_new_services = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] enable_unsupported_driver = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] enabled_backends = ['QuobyteHD'] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] enforce_multipath_for_image_xfer = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] filter_function = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] glance_api_insecure = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] glance_api_servers = ['http://192.168.122.107/image'] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] glance_api_ssl_compression = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] glance_ca_certificates_file = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] glance_catalog_info = image:glance:publicURL {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] glance_certfile = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] glance_keyfile = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] glance_num_retries = 3 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] glance_request_timeout = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] goodness_function = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] graceful_shutdown_timeout = 5 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] group_api_class = cinder.group.api.API {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] host = devstack {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] image_compress_on_upload = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] image_conversion_address_space_limit = 1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] image_conversion_cpu_limit = 60 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] image_conversion_disable = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] image_introspection_address_space_limit = 1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] image_introspection_cpu_limit = 60 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] image_upload_use_cinder_backend = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] image_upload_use_internal_tenant = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] image_volume_cache_enabled = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] image_volume_cache_max_count = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] image_volume_cache_max_size_gb = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] init_host_max_objects_retrieval = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] instance_format = [instance: %(uuid)s] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85898]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] iscsi_target_flags = {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] iscsi_write_cache = on {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] iser_helper = tgtadm {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] iser_ip_address = 192.168.122.107 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] iser_port = 3260 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] log_color = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] log_config_append = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] log_dir = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] log_file = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] log_options = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] log_rotate_interval = 1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] log_rotate_interval_type = days {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] log_rotation_type = none {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] max_age = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] max_logfile_count = 30 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] max_logfile_size_mb = 200 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] max_over_subscription_ratio = 20.0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] message_reap_interval = 86400 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] message_ttl = 2592000 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] migration_create_volume_timeout_secs = 300 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] monkey_patch = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] monkey_patch_modules = [] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] my_ip = 192.168.122.107 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] no_snapshot_gb_quota = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] num_iser_scan_tries = 3 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] num_shell_tries = 3 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] num_volume_device_scan_tries = 3 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] nvmeof_conn_info_version = 1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] nvmet_ns_id = 10 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] nvmet_port_id = 1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] osapi_max_limit = 1000 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] osapi_volume_ext_list = [] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] osapi_volume_listen = 0.0.0.0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] osapi_volume_listen_port = 8776 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] osapi_volume_use_ssl = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] osapi_volume_workers = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] per_volume_size_limit = -1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] periodic_fuzzy_delay = 60 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] periodic_interval = 60 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] project_id_regex = [0-9a-f\-]+ {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] public_endpoint = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] publish_errors = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] quota_backup_gigabytes = 1000 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] quota_backups = 10 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] quota_gigabytes = 1000 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] quota_groups = 10 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] quota_snapshots = 10 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] quota_volumes = 10 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] rate_limit_burst = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] rate_limit_except_level = CRITICAL {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] rate_limit_interval = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] reinit_driver_count = 3 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] replication_device = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] report_discard_supported = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] report_interval = 120 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] reservation_clean_interval = 86400 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] reservation_expire = 86400 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] reserved_image_namespaces = [] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] reserved_percentage = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] rpc_response_timeout = 120 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] run_external_periodic_tasks = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] scst_target_driver = iscsi {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] scst_target_iqn_name = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] service_down_time = 720 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] shell_completion = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] snapshot_name_template = snapshot-%s {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] split_loggers = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] state_path = /opt/stack/data/cinder {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] storage_availability_zone = nova {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] storage_protocol = iSCSI {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] syslog_log_facility = LOG_USER {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] target_helper = lioadm {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] target_ip_address = 192.168.122.107 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] target_port = 3260 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] target_protocol = iscsi {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] target_secondary_ip_addresses = [] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] trace_flags = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] transfer_api_class = cinder.transfer.api.API {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] transport_url = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] until_refresh = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] use_chap_auth = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] use_default_quota_class = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] use_journal = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] use_json = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] use_multipath_for_image_xfer = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] use_stderr = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] use_syslog = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] verify_glance_signatures = enabled {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] volume_api_class = cinder.volume.api.API {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] volume_backend_name = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] volume_clear = zero {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] volume_clear_ionice = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] volume_clear_size = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] volume_copy_bps_limit = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] volume_dd_blocksize = 1M {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] volume_name_template = volume-%s {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] volume_service_inithost_offload = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] volume_usage_audit_period = month {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] zoning_mode = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_concurrency.disable_process_locking = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.auth_section = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.auth_type = password {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.auth_version = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.cache = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.certfile = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.delay_auth_decision = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.http_connect_timeout = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.include_service_catalog = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.insecure = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.interface = public {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.keyfile = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.memcache_password = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.memcache_username = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.region_name = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.service_token_roles_required = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.service_type = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.token_cache_time = 300 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.107/identity {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.backend = dogpile.cache.null {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.backend_argument = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.backend_expiration_time = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.config_prefix = cache.oslo {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.debug_cache_backend = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.enable_retry_client = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.enable_socket_keepalive = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.enabled = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.expiration_time = 600 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.hashclient_retry_attempts = 2 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.memcache_dead_retry = 300 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.memcache_pool_maxsize = 10 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.memcache_sasl_enabled = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.password = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.proxies = [] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.redis_db = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.redis_sentinel_service_name = mymaster {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.redis_server = localhost:6379 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.retry_attempts = 2 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.retry_delay = 0.0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.socket_keepalive_count = 1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.socket_keepalive_idle = 1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.socket_keepalive_interval = 1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.socket_timeout = 1.0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.tls_allowed_ciphers = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.tls_cafile = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.tls_certfile = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.tls_enabled = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.tls_keyfile = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cache.username = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] coordination.backend_url = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] database.asyncio_connection = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] database.asyncio_slave_connection = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] database.backend = sqlalchemy {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] database.connection = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] database.connection_debug = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] database.connection_parameters = {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] database.connection_recycle_time = 3600 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] database.connection_trace = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] database.db_inc_retry_interval = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] database.db_max_retries = 20 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] database.db_max_retry_interval = 10 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] database.db_retry_interval = 1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] database.max_overflow = 50 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] database.max_pool_size = 5 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] database.max_retries = 10 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] database.mysql_wsrep_sync_wait = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] database.pool_timeout = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] database.retry_interval = 10 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] database.slave_connection = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] database.sqlite_synchronous = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] database.synchronous_reader = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] database.use_db_reconnect = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_tracing.insecure = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] profiler.connection_string = messaging:// {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] profiler.enabled = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] profiler.es_doc_type = notification {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] profiler.es_scroll_size = 10000 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] profiler.es_scroll_time = 2m {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] profiler.filter_error_trace = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] profiler.hmac_keys = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] profiler.sentinel_service_name = mymaster {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] profiler.socket_timeout = 0.1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] profiler.trace_requests = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] profiler.trace_sqlalchemy = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] profiler_jaeger.process_tags = {} {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] profiler_jaeger.service_name_prefix = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] profiler_otlp.service_name_prefix = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_policy.enforce_new_defaults = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_policy.policy_default_rule = default {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_policy.policy_file = policy.yaml {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_policy.remote_timeout = 60.0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] privsep_osbrick.group = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] privsep_osbrick.helper_command = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] privsep_osbrick.user = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cinder_sys_admin.group = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cinder_sys_admin.helper_command = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] cinder_sys_admin.user = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85898]: INFO cinder.volume.manager [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Starting volume driver QuobyteDriver (1.2.1) Nov 02 15:27:43 devstack cinder-volume[85898]: DEBUG cinder.volume.drivers.remotefs [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85898) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] service_user.auth_section = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] service_user.auth_type = password {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] service_user.cafile = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] service_user.certfile = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] service_user.collect_timing = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] service_user.insecure = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] service_user.keyfile = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] service_user.send_service_user_token = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] service_user.split_loggers = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] service_user.timeout = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] service_user.tls_ciphers = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] service_user.tls_min_version = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] glance.auth_section = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] glance.auth_type = password {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] glance.certfile = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] glance.collect_timing = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] glance.insecure = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] glance.keyfile = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] glance.region_name = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] glance.split_loggers = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] glance.timeout = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] glance.tls_ciphers = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] glance.tls_min_version = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.backend_availability_zone = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.chap_password = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.chap_username = {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.disk_geometry = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.driver_client_cert = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.driver_client_cert_key = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.driver_data_namespace = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.driver_use_ssl = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.enable_unsupported_driver = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.extra_capabilities = {} {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.filter_function = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.goodness_function = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.iscsi_target_flags = {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.iscsi_write_cache = on {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.iser_helper = tgtadm {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.iser_ip_address = 192.168.122.107 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.iser_port = 3260 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.nas_host = {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.nas_login = admin {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.nas_mount_options = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.nas_password = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.nas_private_key = {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.nas_share_path = {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.nas_ssh_port = 22 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.num_shell_tries = 3 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.nvmet_port_id = 1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.quobyte_client_cfg = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.quobyte_volume_url = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.replication_device = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.report_discard_supported = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.reserved_percentage = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.scst_target_driver = iscsi {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.scst_target_iqn_name = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.storage_protocol = iSCSI {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.target_helper = tgtadm {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.target_ip_address = 192.168.122.107 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.target_port = 3260 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.target_protocol = iscsi {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.trace_flags = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.unique_fqdn_network = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.use_chap_auth = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.volume_backend_name = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.volume_clear = zero {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.volume_clear_ionice = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.volume_clear_size = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_reports.file_event_handler = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_reports.log_dir = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.backend_availability_zone = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.backend_host = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.chap_password = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.chap_username = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.chiscsi_conf = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.disk_geometry = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.driver_client_cert = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.driver_client_cert_key = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.driver_data_namespace = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.driver_use_ssl = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.extra_capabilities = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.filter_function = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.goodness_function = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.iscsi_target_flags = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.iscsi_write_cache = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.iser_helper = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.iser_ip_address = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.iser_port = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.iser_target_prefix = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.nas_host = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.nas_login = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.nas_mount_options = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.nas_password = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.nas_private_key = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.nas_share_path = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.nas_ssh_port = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.num_shell_tries = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.nvmet_ns_id = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.nvmet_port_id = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85898]: DEBUG cinder.volume.drivers.quobyte [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85898) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.replication_device = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.report_discard_supported = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.reserved_percentage = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.scst_target_driver = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.storage_protocol = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.target_helper = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.target_ip_address = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.target_port = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.target_prefix = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.target_protocol = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.trace_flags = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.unique_fqdn_network = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.use_chap_auth = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.volume_clear = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.volume_clear_ionice = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.volume_clear_size = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85898]: WARNING cinder.volume.drivers.quobyte [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 02 15:27:43 devstack cinder-volume[85898]: WARNING cinder.volume.drivers.quobyte [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85898]: DEBUG oslo_concurrency.processutils [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Running cmd (subprocess): mount.quobyte {{(pid=85898) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] QuobyteHD.volumes_dir = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.ssl = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.ssl_version = {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_notifications.driver = [] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_notifications.retry = -1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] oslo_messaging_notifications.transport_url = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] key_manager.fixed_key = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] barbican.barbican_api_version = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] barbican.barbican_endpoint = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] barbican.barbican_endpoint_type = public {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] barbican.barbican_region_name = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] barbican.cafile = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] barbican.certfile = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] barbican.collect_timing = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] barbican.insecure = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] barbican.keyfile = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] barbican.number_of_retries = 60 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] barbican.retry_delay = 1 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] barbican.send_service_user_token = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] barbican.split_loggers = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] barbican.timeout = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] barbican.tls_ciphers = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] barbican.tls_min_version = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] barbican.verify_ssl = True {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] barbican.verify_ssl_path = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] barbican_service_user.auth_section = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] barbican_service_user.auth_type = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] barbican_service_user.cafile = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] barbican_service_user.certfile = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] barbican_service_user.collect_timing = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] barbican_service_user.insecure = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] barbican_service_user.keyfile = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] barbican_service_user.split_loggers = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] barbican_service_user.timeout = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] barbican_service_user.tls_ciphers = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] barbican_service_user.tls_min_version = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] vault.approle_role_id = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] vault.approle_secret_id = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] vault.auth_method = approle {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] vault.auth_path = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] vault.kv_mountpoint = secret {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] vault.kv_path = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] vault.kv_version = 2 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] vault.namespace = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] vault.root_token_id = **** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] vault.ssl_ca_crt_file = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] vault.timeout = 60.0 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] vault.token_file = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] vault.token_role = None {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] vault.use_ssl = False {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:27:43 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] ******************************************************************************** {{(pid=85644) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 15:27:43 devstack cinder-volume[85898]: DEBUG oslo_concurrency.processutils [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] CMD "mount.quobyte" returned: 1 in 0.074s {{(pid=85898) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:27:43 devstack cinder-volume[85898]: DEBUG oslo_concurrency.lockutils [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85898) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:27:43 devstack cinder-volume[85898]: DEBUG oslo_concurrency.lockutils [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85898) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:27:43 devstack cinder-volume[85898]: DEBUG cinder.volume.drivers.quobyte [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=85898) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:27:43 devstack cinder-volume[85898]: INFO cinder.volume.drivers.quobyte [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 ... Nov 02 15:27:43 devstack cinder-volume[85898]: DEBUG oslo_concurrency.processutils [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 -c /etc/quobyte/client-cinder.cfg {{(pid=85898) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:27:43 devstack sudo[85904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 -c /etc/quobyte/client-cinder.cfg Nov 02 15:27:43 devstack sudo[85904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:27:44 devstack sudo[85904]: pam_unix(sudo:session): session closed for user root Nov 02 15:27:44 devstack cinder-volume[85898]: DEBUG oslo_concurrency.processutils [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.411s {{(pid=85898) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:27:44 devstack cinder-volume[85898]: INFO cinder.volume.drivers.quobyte [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 succeeded Nov 02 15:27:44 devstack cinder-volume[85898]: DEBUG cinder.volume.drivers.quobyte [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=85898) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:27:44 devstack cinder-volume[85898]: DEBUG oslo_concurrency.lockutils [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.420s {{(pid=85898) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:27:44 devstack cinder-volume[85898]: DEBUG oslo_concurrency.processutils [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=85898) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:27:44 devstack sudo[86006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:27:44 devstack sudo[86006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:27:44 devstack cinder-volume[75231]: DEBUG oslo_concurrency.lockutils [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] Acquiring lock "singleton_lock" {{(pid=75231) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 15:27:44 devstack cinder-volume[75231]: DEBUG oslo_concurrency.lockutils [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] Acquired lock "singleton_lock" {{(pid=75231) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 15:27:44 devstack cinder-volume[75231]: DEBUG oslo_concurrency.lockutils [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] Releasing lock "singleton_lock" {{(pid=75231) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 15:27:44 devstack cinder-volume[75231]: WARNING amqp [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 15:27:44 devstack cinder-volume[75231]: WARNING amqp [None req-db75675d-27eb-40f0-a28d-9ed55116a815 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 15:27:44 devstack sudo[86006]: pam_unix(sudo:session): session closed for user root Nov 02 15:27:44 devstack cinder-volume[85898]: DEBUG oslo_concurrency.processutils [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.253s {{(pid=85898) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:27:44 devstack cinder-volume[85898]: INFO cinder.volume.driver [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Driver hasn't implemented _init_vendor_properties() Nov 02 15:27:44 devstack cinder-volume[85898]: DEBUG cinder.volume.driver [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8291549682617, 'free_capacity_gb': 1773.8291549682617, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85898) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 15:27:44 devstack cinder-volume[85898]: DEBUG oslo_db.sqlalchemy.engines [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85898) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 15:27:44 devstack cinder-volume[85898]: DEBUG dbcounter [-] [85898] Writer thread running {{(pid=85898) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 15:27:44 devstack cinder-volume[85898]: DEBUG cinder.db.api [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Building query based on filter {{(pid=85898) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 02 15:27:44 devstack cinder-volume[85898]: DEBUG cinder.image.image_utils [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85898) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 02 15:27:44 devstack cinder-volume[85898]: INFO cinder.keymgr.migration [None req-44790515-6639-418b-a4c8-d86ab4ec79ef None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 15:27:44 devstack cinder-volume[85898]: DEBUG oslo_concurrency.lockutils [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85898) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:27:44 devstack cinder-volume[85898]: DEBUG oslo_concurrency.lockutils [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85898) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:27:44 devstack cinder-volume[85898]: DEBUG cinder.volume.drivers.quobyte [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=85898) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:27:44 devstack cinder-volume[85898]: DEBUG cinder.volume.drivers.quobyte [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=85898) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:27:44 devstack cinder-volume[85898]: DEBUG oslo_concurrency.lockutils [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85898) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:27:44 devstack cinder-volume[85898]: DEBUG oslo_concurrency.processutils [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=85898) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:27:44 devstack sudo[86010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:27:44 devstack sudo[86010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:27:44 devstack sudo[86010]: pam_unix(sudo:session): session closed for user root Nov 02 15:27:44 devstack cinder-volume[85898]: DEBUG oslo_concurrency.processutils [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.248s {{(pid=85898) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:27:44 devstack cinder-volume[85898]: DEBUG cinder.manager [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Notifying Schedulers of capabilities ... {{(pid=85898) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:27:44 devstack cinder-volume[85898]: INFO cinder.volume.manager [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Driver initialization completed successfully. Nov 02 15:27:44 devstack cinder-volume[85898]: INFO cinder.manager [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Initiating service 3 cleanup Nov 02 15:27:44 devstack cinder-volume[85898]: INFO cinder.manager [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Service 3 cleanup completed. Nov 02 15:27:44 devstack cinder-volume[85898]: DEBUG cinder.service [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Creating RPC server for service cinder-volume {{(pid=85898) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 15:27:44 devstack cinder-volume[85898]: DEBUG cinder.service [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85898) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 15:27:45 devstack cinder-volume[85898]: INFO cinder.volume.manager [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 02 15:27:45 devstack cinder-volume[85898]: DEBUG oslo_concurrency.lockutils [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85898) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:27:45 devstack cinder-volume[85898]: DEBUG oslo_concurrency.lockutils [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85898) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:27:45 devstack cinder-volume[85898]: DEBUG cinder.volume.drivers.quobyte [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=85898) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:27:45 devstack cinder-volume[85898]: DEBUG cinder.volume.drivers.quobyte [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=85898) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:27:45 devstack cinder-volume[85898]: DEBUG oslo_concurrency.lockutils [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85898) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:27:45 devstack cinder-volume[85898]: DEBUG oslo_concurrency.processutils [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=85898) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:27:45 devstack sudo[86014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:27:45 devstack sudo[86014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:27:45 devstack sudo[86014]: pam_unix(sudo:session): session closed for user root Nov 02 15:27:45 devstack cinder-volume[85898]: DEBUG oslo_concurrency.processutils [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.261s {{(pid=85898) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:27:45 devstack cinder-volume[85898]: INFO cinder.volume.manager [None req-0d2dfd59-1d41-47c8-b79d-94f42f591b3d None None] Driver post RPC initialization completed successfully. Nov 02 15:27:49 devstack cinder-volume[85898]: DEBUG oslo_concurrency.lockutils [None req-76ec17e5-4205-416d-8e7c-f2aa036fd297 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85898) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:27:49 devstack cinder-volume[85898]: DEBUG oslo_concurrency.lockutils [None req-76ec17e5-4205-416d-8e7c-f2aa036fd297 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85898) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:27:49 devstack cinder-volume[85898]: DEBUG cinder.volume.drivers.quobyte [None req-76ec17e5-4205-416d-8e7c-f2aa036fd297 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=85898) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:27:49 devstack cinder-volume[85898]: DEBUG cinder.volume.drivers.quobyte [None req-76ec17e5-4205-416d-8e7c-f2aa036fd297 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=85898) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:27:49 devstack cinder-volume[85898]: DEBUG oslo_concurrency.lockutils [None req-76ec17e5-4205-416d-8e7c-f2aa036fd297 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=85898) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:27:49 devstack cinder-volume[85898]: DEBUG oslo_concurrency.processutils [None req-76ec17e5-4205-416d-8e7c-f2aa036fd297 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=85898) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:27:49 devstack sudo[86175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:27:49 devstack sudo[86175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:27:50 devstack sudo[86175]: pam_unix(sudo:session): session closed for user root Nov 02 15:27:50 devstack cinder-volume[85898]: DEBUG oslo_concurrency.processutils [None req-76ec17e5-4205-416d-8e7c-f2aa036fd297 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.229s {{(pid=85898) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:27:50 devstack cinder-volume[85898]: DEBUG cinder.manager [None req-76ec17e5-4205-416d-8e7c-f2aa036fd297 None None] Notifying Schedulers of capabilities ... {{(pid=85898) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:27:53 devstack cinder-volume[85644]: INFO oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] Caught SIGTERM, stopping children Nov 02 15:27:53 devstack cinder-volume[85644]: DEBUG oslo_concurrency.lockutils [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] Acquiring lock "singleton_lock" {{(pid=85644) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 15:27:53 devstack cinder-volume[85644]: DEBUG oslo_concurrency.lockutils [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] Acquired lock "singleton_lock" {{(pid=85644) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 15:27:53 devstack cinder-volume[85644]: DEBUG oslo_concurrency.lockutils [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] Releasing lock "singleton_lock" {{(pid=85644) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 15:27:53 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] Stop services. {{(pid=85644) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 02 15:27:53 devstack cinder-volume[85644]: DEBUG oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] Killing children. {{(pid=85644) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 02 15:27:53 devstack cinder-volume[85644]: INFO oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] Waiting on 1 children to exit Nov 02 15:27:55 devstack cinder-volume[85898]: DEBUG dbcounter [-] [85898] Writing DB stats cinder:SELECT=4 {{(pid=85898) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:27:55 devstack cinder-volume[85898]: DEBUG dbcounter [-] [85898] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=85898) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:27:58 devstack cinder-volume[85898]: DEBUG oslo_concurrency.lockutils [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] Acquiring lock "singleton_lock" {{(pid=85898) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 15:27:58 devstack cinder-volume[85898]: DEBUG oslo_concurrency.lockutils [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] Acquired lock "singleton_lock" {{(pid=85898) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 15:27:58 devstack cinder-volume[85898]: DEBUG oslo_concurrency.lockutils [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] Releasing lock "singleton_lock" {{(pid=85898) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 15:27:58 devstack cinder-volume[85898]: WARNING amqp [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 15:27:58 devstack cinder-volume[85898]: WARNING amqp [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 02 15:27:58 devstack cinder-volume[85644]: INFO oslo_service.backend._eventlet.service [None req-a2a844c0-f1fe-4998-a29c-ebbe12e2b24f None None] Child 85898 exited with status 0 Nov 02 15:27:59 devstack cinder-volume[86399]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 02 15:27:59 devstack cinder-volume[86399]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 15:27:59 devstack cinder-volume[86399]: we strongly recommend against using it for new projects. Nov 02 15:27:59 devstack cinder-volume[86399]: If you are already using Eventlet, we recommend migrating to a different Nov 02 15:27:59 devstack cinder-volume[86399]: framework. For more detail see Nov 02 15:27:59 devstack cinder-volume[86399]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 15:27:59 devstack cinder-volume[86399]: import eventlet # noqa Nov 02 15:28:02 devstack cinder-volume[86399]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86399) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 02 15:28:02 devstack cinder-volume[86399]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86399) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 02 15:28:02 devstack cinder-volume[86399]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86399) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 02 15:28:02 devstack cinder-volume[86399]: INFO dbcounter [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] Registered counter for database cinder Nov 02 15:28:02 devstack cinder-volume[86399]: DEBUG oslo_db.sqlalchemy.engines [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86399) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG dbcounter [-] [86399] Writer thread running {{(pid=86399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 15:28:03 devstack cinder-volume[86399]: INFO cinder.rpc [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 02 15:28:03 devstack cinder-volume[86399]: INFO cinder.rpc [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_db.sqlalchemy.engines [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86399) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 15:28:03 devstack cinder-volume[86399]: INFO cinder.volume.manager [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] Determined volume DB was empty at startup. Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG cinder.volume.manager [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86399) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 02 15:28:03 devstack cinder-volume[86399]: WARNING stevedore.named [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 02 15:28:03 devstack cinder-volume[86399]: WARNING castellan.key_manager [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 15:28:03 devstack cinder-volume[86399]: WARNING cinder.keymgr.conf_key_mgr [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 02 15:28:03 devstack cinder-volume[86399]: INFO cinder.volume.manager [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_db.sqlalchemy.engines [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86399) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 15:28:03 devstack cinder-volume[86399]: INFO oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] Starting 1 workers Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] Started child 86703 {{(pid=86399) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] Full set of CONF: {{(pid=86399) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] ******************************************************************************** {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] Configuration options gathered from: {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] ================================================================================ {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] allow_availability_zone_fallback = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] allow_compression_on_image_upload = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] allowed_direct_url_schemes = [] {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] api_rate_limit = True {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] auth_strategy = keystone {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_availability_zone = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_host = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_name = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_stats_polling_interval = 60 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backup_api_class = cinder.backup.api.API {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86703]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backup_name_template = backup-%s {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backup_use_same_host = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backup_use_temp_snapshot = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] chap_password = **** {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] chap_username = {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cinder_internal_tenant_project_id = a632681fc076490498c0dbe472085959 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cinder_internal_tenant_user_id = 2f3a16bcc5be447782588022a3a84603 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cluster = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] compression_format = gzip {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] compute_api_class = cinder.compute.nova.API {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] config_dir = [] {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] config_source = [] {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] control_exchange = openstack {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] debug = True {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] default_availability_zone = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] default_group_type = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] default_volume_type = QuobyteHD {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] disk_geometry = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] driver_client_cert = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] driver_client_cert_key = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] driver_data_namespace = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] driver_ssl_cert_path = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] driver_ssl_cert_verify = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] driver_use_ssl = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] enable_new_services = True {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] enable_unsupported_driver = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] enabled_backends = ['QuobyteHD'] {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] enforce_multipath_for_image_xfer = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] filter_function = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] glance_api_insecure = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] glance_api_servers = ['http://192.168.122.107/image'] {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] glance_api_ssl_compression = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] glance_ca_certificates_file = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] glance_catalog_info = image:glance:publicURL {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] glance_certfile = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] glance_keyfile = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] glance_num_retries = 3 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] glance_request_timeout = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] goodness_function = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] graceful_shutdown_timeout = 5 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] group_api_class = cinder.group.api.API {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] host = devstack {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] image_compress_on_upload = True {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] image_conversion_address_space_limit = 1 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] image_conversion_cpu_limit = 60 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] image_conversion_disable = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] image_introspection_address_space_limit = 1 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] image_introspection_cpu_limit = 60 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] image_upload_use_cinder_backend = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] image_upload_use_internal_tenant = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] image_volume_cache_enabled = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] image_volume_cache_max_count = 0 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] image_volume_cache_max_size_gb = 0 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] init_host_max_objects_retrieval = 0 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] instance_format = [instance: %(uuid)s] {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] iscsi_target_flags = {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] iscsi_write_cache = on {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] iser_helper = tgtadm {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] iser_ip_address = 192.168.122.107 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] iser_port = 3260 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] log_color = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] log_config_append = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] log_dir = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] log_file = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] log_options = True {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] log_rotate_interval = 1 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] log_rotate_interval_type = days {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] log_rotation_type = none {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] max_age = 0 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] max_logfile_count = 30 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] max_logfile_size_mb = 200 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] max_over_subscription_ratio = 20.0 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] message_reap_interval = 86400 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] message_ttl = 2592000 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] migration_create_volume_timeout_secs = 300 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] monkey_patch = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] monkey_patch_modules = [] {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] my_ip = 192.168.122.107 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] no_snapshot_gb_quota = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] num_iser_scan_tries = 3 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] num_shell_tries = 3 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] num_volume_device_scan_tries = 3 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] nvmeof_conn_info_version = 1 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] nvmet_ns_id = 10 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] nvmet_port_id = 1 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] osapi_max_limit = 1000 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] osapi_volume_ext_list = [] {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] osapi_volume_listen_port = 8776 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] Starting volume driver QuobyteDriver (1.2.1) Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] osapi_volume_use_ssl = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86703) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] osapi_volume_workers = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] per_volume_size_limit = -1 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] periodic_fuzzy_delay = 60 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] periodic_interval = 60 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] public_endpoint = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] publish_errors = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] quota_backup_gigabytes = 1000 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] quota_backups = 10 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] quota_gigabytes = 1000 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] quota_groups = 10 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] quota_snapshots = 10 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] quota_volumes = 10 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] rate_limit_burst = 0 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] rate_limit_except_level = CRITICAL {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] rate_limit_interval = 0 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] reinit_driver_count = 3 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] replication_device = **** {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] report_discard_supported = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] report_interval = 120 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] reservation_clean_interval = 86400 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] reservation_expire = 86400 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] reserved_image_namespaces = [] {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] reserved_percentage = 0 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] rpc_response_timeout = 120 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] run_external_periodic_tasks = True {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] scst_target_driver = iscsi {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] scst_target_iqn_name = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] service_down_time = 720 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] shell_completion = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] snapshot_name_template = snapshot-%s {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] split_loggers = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] state_path = /opt/stack/data/cinder {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] storage_availability_zone = nova {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] storage_protocol = iSCSI {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] syslog_log_facility = LOG_USER {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] target_helper = lioadm {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] target_ip_address = 192.168.122.107 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] target_port = 3260 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] target_protocol = iscsi {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] target_secondary_ip_addresses = [] {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] trace_flags = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] transport_url = **** {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] until_refresh = 0 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] use_chap_auth = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] use_default_quota_class = True {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] use_journal = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] use_json = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] use_multipath_for_image_xfer = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] use_stderr = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] use_syslog = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] verify_glance_signatures = enabled {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] volume_api_class = cinder.volume.api.API {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] volume_backend_name = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] volume_clear = zero {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] volume_clear_ionice = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] volume_clear_size = 0 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] volume_copy_bps_limit = 0 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] volume_dd_blocksize = 1M {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] volume_name_template = volume-%s {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] volume_service_inithost_offload = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] volume_usage_audit_period = month {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] zoning_mode = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_concurrency.disable_process_locking = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.auth_section = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.auth_type = password {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.auth_version = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.cache = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.certfile = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.include_service_catalog = True {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.insecure = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.interface = public {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.keyfile = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.memcache_password = **** {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.memcache_username = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.region_name = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.service_type = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.107/identity {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.backend = dogpile.cache.null {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.backend_argument = **** {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.backend_expiration_time = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.config_prefix = cache.oslo {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.debug_cache_backend = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.enable_retry_client = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.enable_socket_keepalive = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.enabled = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.expiration_time = 600 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.hashclient_retry_attempts = 2 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.memcache_dead_retry = 300 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.memcache_pool_maxsize = 10 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.memcache_sasl_enabled = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.password = **** {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.proxies = [] {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.redis_db = 0 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.redis_server = localhost:6379 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.retry_attempts = 2 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86703) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.retry_delay = 0.0 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.socket_keepalive_count = 1 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.socket_keepalive_idle = 1 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.socket_keepalive_interval = 1 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.quobyte [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.socket_timeout = 1.0 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.tls_allowed_ciphers = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.tls_cafile = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.tls_certfile = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.tls_enabled = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.tls_keyfile = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cache.username = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] coordination.backend_url = **** {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] database.asyncio_connection = **** {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] database.asyncio_slave_connection = **** {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] database.backend = sqlalchemy {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] database.connection = **** {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] database.connection_debug = 0 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] database.connection_parameters = {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] database.connection_recycle_time = 3600 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] database.connection_trace = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] database.db_inc_retry_interval = True {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] database.db_max_retries = 20 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] database.db_max_retry_interval = 10 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] database.db_retry_interval = 1 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.quobyte [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] database.max_overflow = 50 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] database.max_pool_size = 5 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] database.max_retries = 10 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] database.mysql_wsrep_sync_wait = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] database.pool_timeout = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] database.retry_interval = 10 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] database.slave_connection = **** {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] database.sqlite_synchronous = True {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] database.synchronous_reader = True {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] database.use_db_reconnect = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_tracing.insecure = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] Running cmd (subprocess): mount.quobyte {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] profiler.connection_string = messaging:// {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] profiler.enabled = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] profiler.es_doc_type = notification {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] profiler.es_scroll_size = 10000 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] profiler.es_scroll_time = 2m {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] profiler.filter_error_trace = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] profiler.hmac_keys = **** {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] profiler.sentinel_service_name = mymaster {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] profiler.socket_timeout = 0.1 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] profiler.trace_requests = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] profiler.trace_sqlalchemy = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] profiler_jaeger.process_tags = {} {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] profiler_jaeger.service_name_prefix = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] profiler_otlp.service_name_prefix = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_policy.enforce_new_defaults = True {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_policy.policy_default_rule = default {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_policy.policy_file = policy.yaml {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] privsep_osbrick.group = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] privsep_osbrick.helper_command = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] privsep_osbrick.user = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cinder_sys_admin.group = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cinder_sys_admin.helper_command = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] cinder_sys_admin.user = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] service_user.auth_section = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] service_user.auth_type = password {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] service_user.cafile = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] service_user.certfile = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] service_user.collect_timing = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] service_user.insecure = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] service_user.keyfile = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] service_user.send_service_user_token = True {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] service_user.split_loggers = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] service_user.timeout = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] service_user.tls_ciphers = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] service_user.tls_min_version = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] glance.auth_section = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] glance.auth_type = password {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] glance.certfile = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] glance.collect_timing = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] glance.insecure = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] glance.keyfile = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] glance.region_name = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] glance.split_loggers = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] glance.timeout = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] glance.tls_ciphers = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] glance.tls_min_version = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.backend_availability_zone = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.chap_password = **** {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.chap_username = {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.disk_geometry = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.driver_client_cert = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.driver_client_cert_key = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.driver_data_namespace = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.driver_use_ssl = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.extra_capabilities = {} {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.filter_function = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.goodness_function = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.iscsi_target_flags = {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.iscsi_write_cache = on {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.iser_helper = tgtadm {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.iser_ip_address = 192.168.122.107 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.iser_port = 3260 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.nas_host = {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.nas_login = admin {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.nas_mount_options = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.nas_password = **** {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.nas_private_key = {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.nas_share_path = {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.num_shell_tries = 3 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.quobyte_volume_url = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.replication_device = **** {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.report_discard_supported = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.reserved_percentage = 0 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.target_helper = tgtadm {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.target_ip_address = 192.168.122.107 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.target_port = 3260 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.target_protocol = iscsi {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.trace_flags = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.unique_fqdn_network = True {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.use_chap_auth = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.volume_backend_name = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.volume_clear = zero {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.volume_clear_ionice = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack quobyte-client[86705]: Reading configuration file: /etc/quobyte/client.cfg Nov 02 15:28:03 devstack quobyte-client[86705]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.volume_clear_size = 0 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] CMD "mount.quobyte" returned: 1 in 0.090s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_reports.file_event_handler = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_reports.log_dir = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.backend_availability_zone = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.backend_host = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.chap_password = **** {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.chap_username = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.chiscsi_conf = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.disk_geometry = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.driver_client_cert = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.driver_data_namespace = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.driver_use_ssl = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.extra_capabilities = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.filter_function = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.goodness_function = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.iser_helper = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.iser_ip_address = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.iser_port = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.iser_target_prefix = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.nas_host = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.nas_login = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.nas_mount_options = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.nas_password = **** {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.nas_private_key = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.nas_share_path = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.nas_ssh_port = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.num_shell_tries = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.nvmet_port_id = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.replication_device = **** {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.report_discard_supported = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.reserved_percentage = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.scst_target_driver = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.storage_protocol = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.target_helper = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.target_ip_address = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.target_port = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.target_prefix = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.target_protocol = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.trace_flags = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.use_chap_auth = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.volume_clear = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.volume_clear_size = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] QuobyteHD.volumes_dir = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.ssl = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack sudo[86706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack sudo[86706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_notifications.driver = [] {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_notifications.retry = -1 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] key_manager.fixed_key = **** {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] barbican.barbican_api_version = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] barbican.barbican_endpoint = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] barbican.barbican_endpoint_type = public {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] barbican.barbican_region_name = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] barbican.cafile = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] barbican.certfile = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] barbican.collect_timing = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] barbican.insecure = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] barbican.keyfile = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] barbican.number_of_retries = 60 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] barbican.retry_delay = 1 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] barbican.send_service_user_token = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] barbican.split_loggers = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] barbican.timeout = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] barbican.tls_ciphers = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] barbican.tls_min_version = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] barbican.verify_ssl = True {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] barbican.verify_ssl_path = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] barbican_service_user.auth_section = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] barbican_service_user.auth_type = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] barbican_service_user.cafile = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] barbican_service_user.certfile = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] barbican_service_user.collect_timing = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] barbican_service_user.insecure = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] barbican_service_user.keyfile = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] barbican_service_user.split_loggers = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] barbican_service_user.timeout = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] barbican_service_user.tls_ciphers = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] barbican_service_user.tls_min_version = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] vault.approle_role_id = **** {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] vault.approle_secret_id = **** {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] vault.auth_method = approle {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] vault.auth_path = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] vault.kv_mountpoint = secret {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] vault.kv_path = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] vault.kv_version = 2 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] vault.namespace = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] vault.root_token_id = **** {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] vault.ssl_ca_crt_file = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] vault.timeout = 60.0 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] vault.token_file = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] vault.token_role = None {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] vault.use_ssl = False {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 02 15:28:03 devstack cinder-volume[86399]: DEBUG oslo_service.backend._eventlet.service [None req-a713eb30-f68d-48c7-9fe4-2f84b0899ab1 None None] ******************************************************************************** {{(pid=86399) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 02 15:28:03 devstack sudo[86706]: pam_unix(sudo:session): session closed for user root Nov 02 15:28:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.266s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:28:03 devstack cinder-volume[86703]: INFO cinder.volume.driver [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] Driver hasn't implemented _init_vendor_properties() Nov 02 15:28:03 devstack cinder-volume[86703]: DEBUG cinder.volume.driver [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8291549682617, 'free_capacity_gb': 1773.8291549682617, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86703) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 02 15:28:03 devstack cinder-volume[86703]: DEBUG oslo_db.sqlalchemy.engines [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86703) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 02 15:28:03 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writer thread running {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 02 15:28:03 devstack cinder-volume[86703]: DEBUG cinder.db.api [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] Building query based on filter {{(pid=86703) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 02 15:28:03 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86703) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 02 15:28:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:28:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:28:03 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:28:03 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:28:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:28:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:28:03 devstack cinder-volume[86703]: INFO cinder.keymgr.migration [None req-c24ba1d8-f41d-4af0-9f1c-cde5163343b4 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 02 15:28:03 devstack sudo[86709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:28:03 devstack sudo[86709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:28:04 devstack sudo[86709]: pam_unix(sudo:session): session closed for user root Nov 02 15:28:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.226s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:28:04 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:28:04 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] Driver initialization completed successfully. Nov 02 15:28:04 devstack cinder-volume[86703]: INFO cinder.manager [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] Initiating service 3 cleanup Nov 02 15:28:04 devstack cinder-volume[86703]: INFO cinder.manager [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] Service 3 cleanup completed. Nov 02 15:28:04 devstack cinder-volume[86703]: DEBUG cinder.service [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] Creating RPC server for service cinder-volume {{(pid=86703) start /opt/stack/cinder/cinder/service.py:231}} Nov 02 15:28:04 devstack cinder-volume[86703]: DEBUG cinder.service [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86703) start /opt/stack/cinder/cinder/service.py:237}} Nov 02 15:28:04 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 02 15:28:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:28:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:28:04 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:28:04 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:28:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:28:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:28:04 devstack sudo[86742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:28:04 devstack sudo[86742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:28:04 devstack sudo[86742]: pam_unix(sudo:session): session closed for user root Nov 02 15:28:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.233s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:28:04 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-d315efbe-09da-4ace-a250-7d0d10d1070f None None] Driver post RPC initialization completed successfully. Nov 02 15:28:13 devstack cinder-volume[86399]: DEBUG dbcounter [-] [86399] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86399) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:28:14 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:28:14 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=2 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:28:20 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager._thread_info {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:28:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread count: 6 {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 15:28:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread info: [<_MainThread(MainThread, started 125876361756800)>, , , , , ] {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 15:29:17 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:29:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] Flow 'volume_create_manager' (227e28d0-0206-40e1-974b-e47c9fb5f456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:29:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00c1657a-6a72-4c7f-9d86-c13223f510c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:29:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00c1657a-6a72-4c7f-9d86-c13223f510c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1035504957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ceede5-49ce-4ae7-9b54-70f0bda8c7a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21682e892da4f40998063d68f3efd97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:29:17Z,use_quota=True,user_id='a39f75410a6e409582d35af354826684',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:29:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acd82ea3-168d-4372-95a3-e897a10418fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:29:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acd82ea3-168d-4372-95a3-e897a10418fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:29:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c26d997-7042-4cc9-b60c-2bea1bd08dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:29:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c26d997-7042-4cc9-b60c-2bea1bd08dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91ceede5-49ce-4ae7-9b54-70f0bda8c7a7', 'volume_name': 'volume-91ceede5-49ce-4ae7-9b54-70f0bda8c7a7', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:29:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf7625a-3fa7-411a-8e1f-8d32cfedb033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:29:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbf7625a-3fa7-411a-8e1f-8d32cfedb033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:29:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89106b45-a4f1-4902-8783-96d6d4b72276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:29:17 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] Volume 91ceede5-49ce-4ae7-9b54-70f0bda8c7a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91ceede5-49ce-4ae7-9b54-70f0bda8c7a7', 'volume_size': 1} Nov 02 15:29:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:29:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:29:17 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:29:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1035504957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91ceede5-49ce-4ae7-9b54-70f0bda8c7a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e21682e892da4f40998063d68f3efd97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:29:17Z,use_quota=True,user_id='a39f75410a6e409582d35af354826684',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:29:17 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] Creating volume 91ceede5-49ce-4ae7-9b54-70f0bda8c7a7 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:29:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:29:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:29:17 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:29:17 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:29:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:29:17 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:29:17 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:29:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91ceede5-49ce-4ae7-9b54-70f0bda8c7a7 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:29:17 devstack sudo[87128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91ceede5-49ce-4ae7-9b54-70f0bda8c7a7 1073741824 Nov 02 15:29:17 devstack sudo[87128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:29:18 devstack sudo[87128]: pam_unix(sudo:session): session closed for user root Nov 02 15:29:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91ceede5-49ce-4ae7-9b54-70f0bda8c7a7 1073741824" returned: 0 in 1.382s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:29:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91ceede5-49ce-4ae7-9b54-70f0bda8c7a7 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:29:19 devstack sudo[87474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91ceede5-49ce-4ae7-9b54-70f0bda8c7a7 Nov 02 15:29:19 devstack sudo[87474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:29:19 devstack sudo[87474]: pam_unix(sudo:session): session closed for user root Nov 02 15:29:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91ceede5-49ce-4ae7-9b54-70f0bda8c7a7" returned: 0 in 0.417s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:29:19 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] <== create_volume: return (1977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:29:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.982s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:29:19 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89106b45-a4f1-4902-8783-96d6d4b72276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91ceede5-49ce-4ae7-9b54-70f0bda8c7a7', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:29:19 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4225ce99-4b52-411c-8326-063103779ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:29:19 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] Volume volume-91ceede5-49ce-4ae7-9b54-70f0bda8c7a7 (91ceede5-49ce-4ae7-9b54-70f0bda8c7a7): created successfully Nov 02 15:29:19 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4225ce99-4b52-411c-8326-063103779ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:29:19 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] Flow 'volume_create_manager' (227e28d0-0206-40e1-974b-e47c9fb5f456) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:29:19 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-16555615-9b98-4f4d-937f-57419584e142 tempest-DeleteServersTestJSON-475167478 None] Created volume successfully. Nov 02 15:29:20 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:29:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:29:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:29:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:29:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:29:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:29:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:29:20 devstack sudo[87493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:29:20 devstack sudo[87493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:29:21 devstack sudo[87493]: pam_unix(sudo:session): session closed for user root Nov 02 15:29:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.597s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:29:21 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:29:21 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager._thread_info {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:29:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread count: 6 {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 15:29:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread info: [<_MainThread(MainThread, started 125876361756800)>, , , , , ] {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 15:29:27 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:29:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] Flow 'volume_create_manager' (cff3c1d7-5923-4e98-af29-da1a42650cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:29:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e03bb089-5ce3-4cb8-a26a-9218362f67f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:29:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e03bb089-5ce3-4cb8-a26a-9218362f67f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-282869210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7201d2b8-cd57-4fdd-be0b-294bc9f80bd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='709191a60c5148b5a1f51350f12c122b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:29:27Z,use_quota=True,user_id='98a5204237e44e8cbf49bb60565c3087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:29:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64f17ab8-3080-4c83-8fbb-46122a72561b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:29:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64f17ab8-3080-4c83-8fbb-46122a72561b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:29:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6b3372-978f-4295-9191-e22ffe51728e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:29:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6b3372-978f-4295-9191-e22ffe51728e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7201d2b8-cd57-4fdd-be0b-294bc9f80bd7', 'volume_name': 'volume-7201d2b8-cd57-4fdd-be0b-294bc9f80bd7', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:29:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e5d80c-85da-4315-b510-fd720398d81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:29:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46e5d80c-85da-4315-b510-fd720398d81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:29:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c777d8ab-ec17-451f-8eaf-0020590d0ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:29:27 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] Volume 7201d2b8-cd57-4fdd-be0b-294bc9f80bd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7201d2b8-cd57-4fdd-be0b-294bc9f80bd7', 'volume_size': 1} Nov 02 15:29:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:29:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:29:27 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:29:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-282869210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7201d2b8-cd57-4fdd-be0b-294bc9f80bd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='709191a60c5148b5a1f51350f12c122b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:29:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:29:27Z,use_quota=True,user_id='98a5204237e44e8cbf49bb60565c3087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:29:27 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] Creating volume 7201d2b8-cd57-4fdd-be0b-294bc9f80bd7 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:29:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:29:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:29:27 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:29:27 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:29:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:29:27 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:29:27 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:29:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7201d2b8-cd57-4fdd-be0b-294bc9f80bd7 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:29:27 devstack sudo[87515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7201d2b8-cd57-4fdd-be0b-294bc9f80bd7 1073741824 Nov 02 15:29:27 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:29:27 devstack cinder-volume[86703]: WARNING py.warnings [req-118b6f81-024a-4861-8924-d337180afb2c req-e3071ba0-eb55-4439-89ab-a74add630660 tempest-DeleteServersTestJSON-475167478 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Nov 02 15:29:27 devstack cinder-volume[86703]: .first() Nov 02 15:29:27 devstack cinder-volume[86703]: Nov 02 15:29:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-118b6f81-024a-4861-8924-d337180afb2c req-e3071ba0-eb55-4439-89ab-a74add630660 tempest-DeleteServersTestJSON-475167478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:29:28 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root Nov 02 15:29:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7201d2b8-cd57-4fdd-be0b-294bc9f80bd7 1073741824" returned: 0 in 0.868s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:29:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7201d2b8-cd57-4fdd-be0b-294bc9f80bd7 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:29:28 devstack sudo[87529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7201d2b8-cd57-4fdd-be0b-294bc9f80bd7 Nov 02 15:29:28 devstack sudo[87529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:29:28 devstack sudo[87529]: pam_unix(sudo:session): session closed for user root Nov 02 15:29:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7201d2b8-cd57-4fdd-be0b-294bc9f80bd7" returned: 0 in 0.469s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:29:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:29:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.413s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:29:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-118b6f81-024a-4861-8924-d337180afb2c req-e3071ba0-eb55-4439-89ab-a74add630660 tempest-DeleteServersTestJSON-475167478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.131s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:29:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c777d8ab-ec17-451f-8eaf-0020590d0ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7201d2b8-cd57-4fdd-be0b-294bc9f80bd7', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:29:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba72372-26cd-44a7-9da5-915ed993a497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:29:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-118b6f81-024a-4861-8924-d337180afb2c req-e3071ba0-eb55-4439-89ab-a74add630660 tempest-DeleteServersTestJSON-475167478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.107s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:29:28 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] Volume volume-7201d2b8-cd57-4fdd-be0b-294bc9f80bd7 (7201d2b8-cd57-4fdd-be0b-294bc9f80bd7): created successfully Nov 02 15:29:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aba72372-26cd-44a7-9da5-915ed993a497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:29:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] Flow 'volume_create_manager' (cff3c1d7-5923-4e98-af29-da1a42650cce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:29:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-118b6f81-024a-4861-8924-d337180afb2c req-e3071ba0-eb55-4439-89ab-a74add630660 tempest-DeleteServersTestJSON-475167478 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478', 'name': 'volume-91ceede5-49ce-4ae7-9b54-70f0bda8c7a7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b87c229-413c-417a-a23d-514fcb920fc4', 'enforce_multipath': True} {{(pid=86703) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 15:29:28 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-7f54b347-b052-4d74-829f-b1562f25b514 tempest-VolumesAdminNegativeTest-1825280044 None] Created volume successfully. Nov 02 15:29:28 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-118b6f81-024a-4861-8924-d337180afb2c req-e3071ba0-eb55-4439-89ab-a74add630660 tempest-DeleteServersTestJSON-475167478 None] attachment_update completed successfully. Nov 02 15:29:29 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a93b1abb-a60e-4793-83bf-c087be1ebc0d tempest-VolumesAdminNegativeTest-1825280044 None] Acquiring lock "cinder-7201d2b8-cd57-4fdd-be0b-294bc9f80bd7-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:29:29 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a93b1abb-a60e-4793-83bf-c087be1ebc0d tempest-VolumesAdminNegativeTest-1825280044 None] Lock "cinder-7201d2b8-cd57-4fdd-be0b-294bc9f80bd7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:29:29 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a93b1abb-a60e-4793-83bf-c087be1ebc0d tempest-VolumesAdminNegativeTest-1825280044 None] Acquiring lock "cinder-quobyte-7201d2b8-cd57-4fdd-be0b-294bc9f80bd7" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:29:29 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a93b1abb-a60e-4793-83bf-c087be1ebc0d tempest-VolumesAdminNegativeTest-1825280044 None] Lock "cinder-quobyte-7201d2b8-cd57-4fdd-be0b-294bc9f80bd7" acquired by "delete_volume" :: waited 0.044s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:29:29 devstack cinder-volume[86703]: INFO oslo.privsep.daemon [None req-a93b1abb-a60e-4793-83bf-c087be1ebc0d tempest-VolumesAdminNegativeTest-1825280044 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp21fsy8fc/privsep.sock'] Nov 02 15:29:29 devstack sudo[87830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp21fsy8fc/privsep.sock Nov 02 15:29:29 devstack sudo[87830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:29:31 devstack cinder-volume[86703]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 02 15:29:31 devstack cinder-volume[86703]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 02 15:29:31 devstack cinder-volume[86703]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 02 15:29:31 devstack cinder-volume[86703]: WARNING oslo.privsep.daemon [-] privsep log: Nov 02 15:29:31 devstack cinder-volume[86703]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 02 15:29:31 devstack cinder-volume[86703]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 02 15:29:31 devstack cinder-volume[86703]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 02 15:29:31 devstack cinder-volume[86703]: WARNING oslo.privsep.daemon [-] privsep log: Nov 02 15:29:31 devstack cinder-volume[86703]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 02 15:29:31 devstack sudo[87830]: pam_unix(sudo:session): session closed for user root Nov 02 15:29:31 devstack cinder-volume[86703]: INFO oslo.privsep.daemon [None req-a93b1abb-a60e-4793-83bf-c087be1ebc0d tempest-VolumesAdminNegativeTest-1825280044 None] Spawned new privsep daemon via rootwrap Nov 02 15:29:31 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [None req-a93b1abb-a60e-4793-83bf-c087be1ebc0d tempest-VolumesAdminNegativeTest-1825280044 None] Accepted privsep connection to /tmp/tmp21fsy8fc/privsep.sock {{(pid=86703) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 02 15:29:31 devstack cinder-volume[86703]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 02 15:29:31 devstack cinder-volume[86703]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 02 15:29:31 devstack cinder-volume[86703]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 02 15:29:31 devstack cinder-volume[86703]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87976 Nov 02 15:29:31 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[df037b64-f190-4fd2-ad8e-06de414059bd]: (2,) {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:29:31 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[30607dd4-4e99-44ce-89a5-eaaea563afe8]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:29:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a93b1abb-a60e-4793-83bf-c087be1ebc0d tempest-VolumesAdminNegativeTest-1825280044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7201d2b8-cd57-4fdd-be0b-294bc9f80bd7 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:29:31 devstack sudo[87978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7201d2b8-cd57-4fdd-be0b-294bc9f80bd7 Nov 02 15:29:31 devstack sudo[87978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:29:32 devstack sudo[87978]: pam_unix(sudo:session): session closed for user root Nov 02 15:29:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a93b1abb-a60e-4793-83bf-c087be1ebc0d tempest-VolumesAdminNegativeTest-1825280044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7201d2b8-cd57-4fdd-be0b-294bc9f80bd7" returned: 0 in 0.634s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:29:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a93b1abb-a60e-4793-83bf-c087be1ebc0d tempest-VolumesAdminNegativeTest-1825280044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7201d2b8-cd57-4fdd-be0b-294bc9f80bd7 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:29:32 devstack sudo[87995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7201d2b8-cd57-4fdd-be0b-294bc9f80bd7 Nov 02 15:29:32 devstack sudo[87995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:29:33 devstack sudo[87995]: pam_unix(sudo:session): session closed for user root Nov 02 15:29:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a93b1abb-a60e-4793-83bf-c087be1ebc0d tempest-VolumesAdminNegativeTest-1825280044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7201d2b8-cd57-4fdd-be0b-294bc9f80bd7" returned: 0 in 0.711s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:29:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a93b1abb-a60e-4793-83bf-c087be1ebc0d tempest-VolumesAdminNegativeTest-1825280044 None] Lock "cinder-quobyte-7201d2b8-cd57-4fdd-be0b-294bc9f80bd7" released by "delete_volume" :: held 3.224s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:29:33 devstack cinder-volume[86703]: WARNING cinder.quota [None req-a93b1abb-a60e-4793-83bf-c087be1ebc0d tempest-VolumesAdminNegativeTest-1825280044 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 15:29:33 devstack cinder-volume[86703]: WARNING cinder.quota [None req-a93b1abb-a60e-4793-83bf-c087be1ebc0d tempest-VolumesAdminNegativeTest-1825280044 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 15:29:33 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-a93b1abb-a60e-4793-83bf-c087be1ebc0d tempest-VolumesAdminNegativeTest-1825280044 None] Created reservations ['7a8fee6d-7a1e-4a05-a638-74cb5abb626b', '97d92fc5-8353-4d2c-b563-eb9025419616', 'f119de03-fabf-45d0-b375-30a6d707c270', '91a16e4e-a184-409e-a918-e6d39cb7723a'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:29:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a93b1abb-a60e-4793-83bf-c087be1ebc0d tempest-VolumesAdminNegativeTest-1825280044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:29:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a93b1abb-a60e-4793-83bf-c087be1ebc0d tempest-VolumesAdminNegativeTest-1825280044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:29:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-a93b1abb-a60e-4793-83bf-c087be1ebc0d tempest-VolumesAdminNegativeTest-1825280044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:29:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-a93b1abb-a60e-4793-83bf-c087be1ebc0d tempest-VolumesAdminNegativeTest-1825280044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:29:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a93b1abb-a60e-4793-83bf-c087be1ebc0d tempest-VolumesAdminNegativeTest-1825280044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:29:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a93b1abb-a60e-4793-83bf-c087be1ebc0d tempest-VolumesAdminNegativeTest-1825280044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:29:33 devstack sudo[88034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:29:33 devstack sudo[88034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:29:34 devstack sudo[88034]: pam_unix(sudo:session): session closed for user root Nov 02 15:29:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a93b1abb-a60e-4793-83bf-c087be1ebc0d tempest-VolumesAdminNegativeTest-1825280044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.526s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:29:34 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-a93b1abb-a60e-4793-83bf-c087be1ebc0d tempest-VolumesAdminNegativeTest-1825280044 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:29:34 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-a93b1abb-a60e-4793-83bf-c087be1ebc0d tempest-VolumesAdminNegativeTest-1825280044 None] Deleted volume successfully. Nov 02 15:29:34 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a93b1abb-a60e-4793-83bf-c087be1ebc0d tempest-VolumesAdminNegativeTest-1825280044 None] Lock "cinder-7201d2b8-cd57-4fdd-be0b-294bc9f80bd7-delete_volume" released by "delete_volume" :: held 4.453s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:29:35 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-899ed243-75ad-4412-a9db-b57ef77619bf req-53d7c3e8-3dbe-43b6-b909-3e67b7740baa tempest-DeleteServersTestJSON-475167478 None] Terminate volume connection completed successfully. Nov 02 15:29:35 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-899ed243-75ad-4412-a9db-b57ef77619bf req-53d7c3e8-3dbe-43b6-b909-3e67b7740baa tempest-DeleteServersTestJSON-475167478 None] Deleting attachment 5b87c229-413c-417a-a23d-514fcb920fc4. {{(pid=86703) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 15:29:37 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-606f63a0-2c43-4c20-b115-2f1e4ddde425 tempest-DeleteServersTestJSON-475167478 None] Acquiring lock "cinder-91ceede5-49ce-4ae7-9b54-70f0bda8c7a7-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:29:37 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-606f63a0-2c43-4c20-b115-2f1e4ddde425 tempest-DeleteServersTestJSON-475167478 None] Lock "cinder-91ceede5-49ce-4ae7-9b54-70f0bda8c7a7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:29:37 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-606f63a0-2c43-4c20-b115-2f1e4ddde425 tempest-DeleteServersTestJSON-475167478 None] Acquiring lock "cinder-quobyte-91ceede5-49ce-4ae7-9b54-70f0bda8c7a7" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:29:37 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-606f63a0-2c43-4c20-b115-2f1e4ddde425 tempest-DeleteServersTestJSON-475167478 None] Lock "cinder-quobyte-91ceede5-49ce-4ae7-9b54-70f0bda8c7a7" acquired by "delete_volume" :: waited 0.017s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:29:37 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ee641c-2bb4-4f41-bf85-f5b373e613df]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:29:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-606f63a0-2c43-4c20-b115-2f1e4ddde425 tempest-DeleteServersTestJSON-475167478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91ceede5-49ce-4ae7-9b54-70f0bda8c7a7 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:29:37 devstack sudo[88083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91ceede5-49ce-4ae7-9b54-70f0bda8c7a7 Nov 02 15:29:37 devstack sudo[88083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:29:38 devstack sudo[88083]: pam_unix(sudo:session): session closed for user root Nov 02 15:29:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-606f63a0-2c43-4c20-b115-2f1e4ddde425 tempest-DeleteServersTestJSON-475167478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91ceede5-49ce-4ae7-9b54-70f0bda8c7a7" returned: 0 in 0.405s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:29:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-606f63a0-2c43-4c20-b115-2f1e4ddde425 tempest-DeleteServersTestJSON-475167478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91ceede5-49ce-4ae7-9b54-70f0bda8c7a7 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:29:38 devstack sudo[88088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91ceede5-49ce-4ae7-9b54-70f0bda8c7a7 Nov 02 15:29:38 devstack sudo[88088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:29:38 devstack sudo[88088]: pam_unix(sudo:session): session closed for user root Nov 02 15:29:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-606f63a0-2c43-4c20-b115-2f1e4ddde425 tempest-DeleteServersTestJSON-475167478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91ceede5-49ce-4ae7-9b54-70f0bda8c7a7" returned: 0 in 0.312s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:29:38 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-606f63a0-2c43-4c20-b115-2f1e4ddde425 tempest-DeleteServersTestJSON-475167478 None] Lock "cinder-quobyte-91ceede5-49ce-4ae7-9b54-70f0bda8c7a7" released by "delete_volume" :: held 0.765s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:29:38 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-606f63a0-2c43-4c20-b115-2f1e4ddde425 tempest-DeleteServersTestJSON-475167478 None] Created reservations ['f3816681-e6eb-4583-a44d-327fcccd9f56', '259776e5-0411-4689-8ad9-63d431b4ecb9', '5db1bc08-3739-4db8-b0e2-6f7c59fb2a96', '3ad22918-31c5-45e5-9f3e-14ea0293b865'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:29:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-606f63a0-2c43-4c20-b115-2f1e4ddde425 tempest-DeleteServersTestJSON-475167478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:29:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-606f63a0-2c43-4c20-b115-2f1e4ddde425 tempest-DeleteServersTestJSON-475167478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:29:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-606f63a0-2c43-4c20-b115-2f1e4ddde425 tempest-DeleteServersTestJSON-475167478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:29:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-606f63a0-2c43-4c20-b115-2f1e4ddde425 tempest-DeleteServersTestJSON-475167478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:29:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-606f63a0-2c43-4c20-b115-2f1e4ddde425 tempest-DeleteServersTestJSON-475167478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:29:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-606f63a0-2c43-4c20-b115-2f1e4ddde425 tempest-DeleteServersTestJSON-475167478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:29:38 devstack sudo[88091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:29:38 devstack sudo[88091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:29:38 devstack sudo[88091]: pam_unix(sudo:session): session closed for user root Nov 02 15:29:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-606f63a0-2c43-4c20-b115-2f1e4ddde425 tempest-DeleteServersTestJSON-475167478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.272s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:29:38 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-606f63a0-2c43-4c20-b115-2f1e4ddde425 tempest-DeleteServersTestJSON-475167478 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:29:38 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-606f63a0-2c43-4c20-b115-2f1e4ddde425 tempest-DeleteServersTestJSON-475167478 None] Deleted volume successfully. Nov 02 15:29:38 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-606f63a0-2c43-4c20-b115-2f1e4ddde425 tempest-DeleteServersTestJSON-475167478 None] Lock "cinder-91ceede5-49ce-4ae7-9b54-70f0bda8c7a7-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:29:42 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-f082661f-9174-4283-bcaf-346ccdd6097a tempest-GroupSnapshotsV319Test-1271126008 None] Group tempest-GroupSnapshotsV319Test-Group-1032010209: creating Nov 02 15:29:42 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-f082661f-9174-4283-bcaf-346ccdd6097a tempest-GroupSnapshotsV319Test-1271126008 None] Group tempest-GroupSnapshotsV319Test-Group-1032010209: created successfully Nov 02 15:29:42 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-f082661f-9174-4283-bcaf-346ccdd6097a tempest-GroupSnapshotsV319Test-1271126008 None] Create group completed successfully. Nov 02 15:29:44 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:29:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] Flow 'volume_create_manager' (48d566a1-0ca0-4891-9597-209c0c67d16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:29:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1e7b72a-1ba8-43a1-ab41-25f2d7ca35c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:29:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1e7b72a-1ba8-43a1-ab41-25f2d7ca35c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-866515692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6f0015f9-8bef-4918-b4f5-aa5b4e86db59,host='devstack@QuobyteHD#QuobyteHD',id=11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19e663a68b9f4861845d1fab194b7ee8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:29:45Z,use_quota=True,user_id='49039062d67843d48fb04244c533d3a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b764ad66-a3b0-4e02-94c5-41a2b86cd559),volume_type_id=b764ad66-a3b0-4e02-94c5-41a2b86cd559)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:29:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc5527e-5a03-4890-9f2c-856c62c8c120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:29:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dc5527e-5a03-4890-9f2c-856c62c8c120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:29:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46191bf3-25c8-4416-88a0-0f4bc03895ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:29:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46191bf3-25c8-4416-88a0-0f4bc03895ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c', 'volume_name': 'volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:29:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70fe1820-7673-4290-a983-d26eb7bfd118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:29:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70fe1820-7673-4290-a983-d26eb7bfd118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:29:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (275adf85-3b47-4bb4-898e-fce5538c6f5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:29:44 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] Volume 11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c', 'volume_size': 1} Nov 02 15:29:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:29:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:29:44 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6f0015f9-8bef-4918-b4f5-aa5b4e86db59,created_at=2026-11-02T14:29:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-866515692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6f0015f9-8bef-4918-b4f5-aa5b4e86db59,host='devstack@QuobyteHD#QuobyteHD',id=11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19e663a68b9f4861845d1fab194b7ee8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:29:45Z,use_quota=True,user_id='49039062d67843d48fb04244c533d3a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b764ad66-a3b0-4e02-94c5-41a2b86cd559),volume_type_id=b764ad66-a3b0-4e02-94c5-41a2b86cd559)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:29:44 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] Creating volume 11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:29:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:29:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:29:44 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:29:44 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:29:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:29:44 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:29:44 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:29:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:29:44 devstack sudo[88135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c 1073741824 Nov 02 15:29:44 devstack sudo[88135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:29:45 devstack sudo[88135]: pam_unix(sudo:session): session closed for user root Nov 02 15:29:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c 1073741824" returned: 0 in 0.670s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:29:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:29:45 devstack sudo[88142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c Nov 02 15:29:45 devstack sudo[88142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:29:45 devstack sudo[88142]: pam_unix(sudo:session): session closed for user root Nov 02 15:29:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c" returned: 0 in 0.299s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:29:45 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:29:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:29:45 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (275adf85-3b47-4bb4-898e-fce5538c6f5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:29:45 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8534e037-259c-4f72-8f8f-c7aeb1767e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:29:45 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] Volume volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c (11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c): created successfully Nov 02 15:29:45 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8534e037-259c-4f72-8f8f-c7aeb1767e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:29:45 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] Flow 'volume_create_manager' (48d566a1-0ca0-4891-9597-209c0c67d16b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:29:46 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-7b18d24d-3d06-47c8-9c0f-78c446614f01 tempest-GroupSnapshotsV319Test-1271126008 None] Created volume successfully. Nov 02 15:29:47 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-a9b45f4c-f791-4598-96e5-927ad468656f tempest-GroupSnapshotsV319Test-1271126008 None] GroupSnapshot 7e074592-49fd-4daf-a031-ee2651085323: creating. Nov 02 15:29:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a9b45f4c-f791-4598-96e5-927ad468656f tempest-GroupSnapshotsV319Test-1271126008 None] Group snapshot 7e074592-49fd-4daf-a031-ee2651085323: creating. {{(pid=86703) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 15:29:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a9b45f4c-f791-4598-96e5-927ad468656f tempest-GroupSnapshotsV319Test-1271126008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:29:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a9b45f4c-f791-4598-96e5-927ad468656f tempest-GroupSnapshotsV319Test-1271126008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:29:47 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-a9b45f4c-f791-4598-96e5-927ad468656f tempest-GroupSnapshotsV319Test-1271126008 None] Creating offline snapshot 7af6c9a2-7ff5-4e99-bf62-3264cb67ee74 of volume 11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:29:47 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5603f84b-df4b-4a11-9955-9e43d2b1e1d3]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:29:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a9b45f4c-f791-4598-96e5-927ad468656f tempest-GroupSnapshotsV319Test-1271126008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:29:47 devstack sudo[88154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c Nov 02 15:29:47 devstack sudo[88154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:29:47 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:29:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] Flow 'volume_create_manager' (3259e9aa-0453-4ed3-8a31-f84bb3948a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:29:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7905480-7123-4a42-8f90-2d5331f54000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:29:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7905480-7123-4a42-8f90-2d5331f54000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-348217418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b21a50a0-70ef-42a5-a3bd-a27666aac5b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be90d541bcc74b2a93f4351dc0b4e597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:29:48Z,use_quota=True,user_id='56c1ef2da53c42b2a6a8b958be556799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:29:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f5b2825-7f01-4944-adaf-b7e1bc0be9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:29:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f5b2825-7f01-4944-adaf-b7e1bc0be9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:29:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba1a92dc-955b-427d-b67d-e5c4c9186183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:29:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba1a92dc-955b-427d-b67d-e5c4c9186183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b21a50a0-70ef-42a5-a3bd-a27666aac5b9', 'volume_name': 'volume-b21a50a0-70ef-42a5-a3bd-a27666aac5b9', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:29:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfdc7899-29f3-4092-8fb0-e311d430a2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:29:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfdc7899-29f3-4092-8fb0-e311d430a2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:29:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de1d5ac-8b1a-4a2c-9e8e-511bb9d5a93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:29:48 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] Volume b21a50a0-70ef-42a5-a3bd-a27666aac5b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b21a50a0-70ef-42a5-a3bd-a27666aac5b9', 'volume_size': 1} Nov 02 15:29:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:29:48 devstack sudo[88154]: pam_unix(sudo:session): session closed for user root Nov 02 15:29:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a9b45f4c-f791-4598-96e5-927ad468656f tempest-GroupSnapshotsV319Test-1271126008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c" returned: 0 in 0.509s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:29:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a9b45f4c-f791-4598-96e5-927ad468656f tempest-GroupSnapshotsV319Test-1271126008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c.7af6c9a2-7ff5-4e99-bf62-3264cb67ee74 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:29:48 devstack sudo[88160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c.7af6c9a2-7ff5-4e99-bf62-3264cb67ee74 1G Nov 02 15:29:48 devstack sudo[88160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:29:48 devstack sudo[88160]: pam_unix(sudo:session): session closed for user root Nov 02 15:29:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a9b45f4c-f791-4598-96e5-927ad468656f tempest-GroupSnapshotsV319Test-1271126008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c.7af6c9a2-7ff5-4e99-bf62-3264cb67ee74 1G" returned: 0 in 0.490s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:29:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a9b45f4c-f791-4598-96e5-927ad468656f tempest-GroupSnapshotsV319Test-1271126008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c.7af6c9a2-7ff5-4e99-bf62-3264cb67ee74 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:29:48 devstack sudo[88168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c.7af6c9a2-7ff5-4e99-bf62-3264cb67ee74 Nov 02 15:29:48 devstack sudo[88168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:29:48 devstack sudo[88168]: pam_unix(sudo:session): session closed for user root Nov 02 15:29:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a9b45f4c-f791-4598-96e5-927ad468656f tempest-GroupSnapshotsV319Test-1271126008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c.7af6c9a2-7ff5-4e99-bf62-3264cb67ee74" returned: 0 in 0.375s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:29:48 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-a9b45f4c-f791-4598-96e5-927ad468656f tempest-GroupSnapshotsV319Test-1271126008 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c.7af6c9a2-7ff5-4e99-bf62-3264cb67ee74 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 15:29:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a9b45f4c-f791-4598-96e5-927ad468656f tempest-GroupSnapshotsV319Test-1271126008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c.7af6c9a2-7ff5-4e99-bf62-3264cb67ee74 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:29:49 devstack sudo[88173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c.7af6c9a2-7ff5-4e99-bf62-3264cb67ee74 Nov 02 15:29:49 devstack sudo[88173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:29:49 devstack sudo[88173]: pam_unix(sudo:session): session closed for user root Nov 02 15:29:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a9b45f4c-f791-4598-96e5-927ad468656f tempest-GroupSnapshotsV319Test-1271126008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c.7af6c9a2-7ff5-4e99-bf62-3264cb67ee74" returned: 0 in 0.330s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:29:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a9b45f4c-f791-4598-96e5-927ad468656f tempest-GroupSnapshotsV319Test-1271126008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:29:49 devstack sudo[88177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c.info Nov 02 15:29:49 devstack sudo[88177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:29:49 devstack sudo[88177]: pam_unix(sudo:session): session closed for user root Nov 02 15:29:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a9b45f4c-f791-4598-96e5-927ad468656f tempest-GroupSnapshotsV319Test-1271126008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c.info" returned: 0 in 0.257s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:29:49 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-a9b45f4c-f791-4598-96e5-927ad468656f tempest-GroupSnapshotsV319Test-1271126008 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 15:29:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a9b45f4c-f791-4598-96e5-927ad468656f tempest-GroupSnapshotsV319Test-1271126008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:29:49 devstack sudo[88180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c.info Nov 02 15:29:49 devstack sudo[88180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:29:49 devstack sudo[88180]: pam_unix(sudo:session): session closed for user root Nov 02 15:29:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a9b45f4c-f791-4598-96e5-927ad468656f tempest-GroupSnapshotsV319Test-1271126008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c.info" returned: 0 in 0.247s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:29:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a9b45f4c-f791-4598-96e5-927ad468656f tempest-GroupSnapshotsV319Test-1271126008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.316s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:29:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.865s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:29:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:29:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-348217418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b21a50a0-70ef-42a5-a3bd-a27666aac5b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be90d541bcc74b2a93f4351dc0b4e597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:29:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:29:48Z,use_quota=True,user_id='56c1ef2da53c42b2a6a8b958be556799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:29:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] Creating volume b21a50a0-70ef-42a5-a3bd-a27666aac5b9 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:29:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:29:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:29:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:29:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:29:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:29:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:29:49 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:29:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b21a50a0-70ef-42a5-a3bd-a27666aac5b9 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:29:49 devstack sudo[88183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b21a50a0-70ef-42a5-a3bd-a27666aac5b9 1073741824 Nov 02 15:29:49 devstack sudo[88183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:29:50 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-a9b45f4c-f791-4598-96e5-927ad468656f tempest-GroupSnapshotsV319Test-1271126008 None] group_snapshot 7e074592-49fd-4daf-a031-ee2651085323: created successfully Nov 02 15:29:50 devstack sudo[88183]: pam_unix(sudo:session): session closed for user root Nov 02 15:29:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b21a50a0-70ef-42a5-a3bd-a27666aac5b9 1073741824" returned: 0 in 0.568s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:29:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b21a50a0-70ef-42a5-a3bd-a27666aac5b9 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:29:50 devstack sudo[88189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b21a50a0-70ef-42a5-a3bd-a27666aac5b9 Nov 02 15:29:50 devstack sudo[88189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:29:50 devstack sudo[88189]: pam_unix(sudo:session): session closed for user root Nov 02 15:29:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b21a50a0-70ef-42a5-a3bd-a27666aac5b9" returned: 0 in 0.293s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:29:50 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:29:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:29:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de1d5ac-8b1a-4a2c-9e8e-511bb9d5a93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b21a50a0-70ef-42a5-a3bd-a27666aac5b9', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:29:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38fb057a-bf9c-4cc5-bd97-f1cf9419be0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:29:50 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] Volume volume-b21a50a0-70ef-42a5-a3bd-a27666aac5b9 (b21a50a0-70ef-42a5-a3bd-a27666aac5b9): created successfully Nov 02 15:29:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38fb057a-bf9c-4cc5-bd97-f1cf9419be0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:29:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] Flow 'volume_create_manager' (3259e9aa-0453-4ed3-8a31-f84bb3948a27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:29:50 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-97a60a3b-3198-41cc-86e3-35b0d83d45bc tempest-AttachVolumeTestJSON-1784642411 None] Created volume successfully. Nov 02 15:29:51 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-0939991b-ce0a-41dd-953d-1d4e4b94e1b4 tempest-GroupSnapshotsV319Test-1271126008 None] group_snapshot 7e074592-49fd-4daf-a031-ee2651085323: deleting Nov 02 15:29:51 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0939991b-ce0a-41dd-953d-1d4e4b94e1b4 tempest-GroupSnapshotsV319Test-1271126008 None] group_snapshot 7e074592-49fd-4daf-a031-ee2651085323: deleting {{(pid=86703) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 15:29:51 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0939991b-ce0a-41dd-953d-1d4e4b94e1b4 tempest-GroupSnapshotsV319Test-1271126008 None] Acquiring lock "cinder-quobyte-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:29:51 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0939991b-ce0a-41dd-953d-1d4e4b94e1b4 tempest-GroupSnapshotsV319Test-1271126008 None] Lock "cinder-quobyte-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:29:51 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0939991b-ce0a-41dd-953d-1d4e4b94e1b4 tempest-GroupSnapshotsV319Test-1271126008 None] Acquiring lock "cinder-quobyte-7af6c9a2-7ff5-4e99-bf62-3264cb67ee74" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:29:52 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0939991b-ce0a-41dd-953d-1d4e4b94e1b4 tempest-GroupSnapshotsV319Test-1271126008 None] Lock "cinder-quobyte-7af6c9a2-7ff5-4e99-bf62-3264cb67ee74" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:29:52 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-0939991b-ce0a-41dd-953d-1d4e4b94e1b4 tempest-GroupSnapshotsV319Test-1271126008 None] Deleting offline snapshot 7af6c9a2-7ff5-4e99-bf62-3264cb67ee74 of volume 11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:29:52 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-0939991b-ce0a-41dd-953d-1d4e4b94e1b4 tempest-GroupSnapshotsV319Test-1271126008 None] snapshot_file for this snap is: volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c.7af6c9a2-7ff5-4e99-bf62-3264cb67ee74 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:29:52 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d26e75-241d-4649-81dc-044a02a57d16]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:29:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0939991b-ce0a-41dd-953d-1d4e4b94e1b4 tempest-GroupSnapshotsV319Test-1271126008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c.7af6c9a2-7ff5-4e99-bf62-3264cb67ee74 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:29:52 devstack sudo[88194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c.7af6c9a2-7ff5-4e99-bf62-3264cb67ee74 Nov 02 15:29:52 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:29:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-6faff940-d348-4eb7-ac0f-fbf7b05ca460 req-da3415c3-74ed-41ed-8a4f-337b1e8166fc tempest-AttachVolumeTestJSON-1784642411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:29:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-6faff940-d348-4eb7-ac0f-fbf7b05ca460 req-da3415c3-74ed-41ed-8a4f-337b1e8166fc tempest-AttachVolumeTestJSON-1784642411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:29:52 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root Nov 02 15:29:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0939991b-ce0a-41dd-953d-1d4e4b94e1b4 tempest-GroupSnapshotsV319Test-1271126008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c.7af6c9a2-7ff5-4e99-bf62-3264cb67ee74" returned: 0 in 0.539s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:29:52 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-0939991b-ce0a-41dd-953d-1d4e4b94e1b4 tempest-GroupSnapshotsV319Test-1271126008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:29:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-6faff940-d348-4eb7-ac0f-fbf7b05ca460 req-da3415c3-74ed-41ed-8a4f-337b1e8166fc tempest-AttachVolumeTestJSON-1784642411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.056s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:29:52 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca452a5-ebcf-4db7-a30d-d8c8a3349ffb]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:29:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0939991b-ce0a-41dd-953d-1d4e4b94e1b4 tempest-GroupSnapshotsV319Test-1271126008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:29:52 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-6faff940-d348-4eb7-ac0f-fbf7b05ca460 req-da3415c3-74ed-41ed-8a4f-337b1e8166fc tempest-AttachVolumeTestJSON-1784642411 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478', 'name': 'volume-b21a50a0-70ef-42a5-a3bd-a27666aac5b9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '351199a1-aeda-4d41-86a6-d66f494b62ca', 'enforce_multipath': True} {{(pid=86703) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 15:29:52 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-6faff940-d348-4eb7-ac0f-fbf7b05ca460 req-da3415c3-74ed-41ed-8a4f-337b1e8166fc tempest-AttachVolumeTestJSON-1784642411 None] attachment_update completed successfully. Nov 02 15:29:52 devstack sudo[88207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c Nov 02 15:29:52 devstack sudo[88207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:29:53 devstack sudo[88207]: pam_unix(sudo:session): session closed for user root Nov 02 15:29:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0939991b-ce0a-41dd-953d-1d4e4b94e1b4 tempest-GroupSnapshotsV319Test-1271126008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c" returned: 0 in 0.614s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:29:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0939991b-ce0a-41dd-953d-1d4e4b94e1b4 tempest-GroupSnapshotsV319Test-1271126008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c.7af6c9a2-7ff5-4e99-bf62-3264cb67ee74 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:29:53 devstack sudo[88387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c.7af6c9a2-7ff5-4e99-bf62-3264cb67ee74 Nov 02 15:29:53 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:29:53 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root Nov 02 15:29:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0939991b-ce0a-41dd-953d-1d4e4b94e1b4 tempest-GroupSnapshotsV319Test-1271126008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c.7af6c9a2-7ff5-4e99-bf62-3264cb67ee74" returned: 0 in 0.600s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:29:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0939991b-ce0a-41dd-953d-1d4e4b94e1b4 tempest-GroupSnapshotsV319Test-1271126008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c.7af6c9a2-7ff5-4e99-bf62-3264cb67ee74 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:29:53 devstack sudo[88632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c.7af6c9a2-7ff5-4e99-bf62-3264cb67ee74 Nov 02 15:29:53 devstack sudo[88632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:29:54 devstack sudo[88632]: pam_unix(sudo:session): session closed for user root Nov 02 15:29:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0939991b-ce0a-41dd-953d-1d4e4b94e1b4 tempest-GroupSnapshotsV319Test-1271126008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c.7af6c9a2-7ff5-4e99-bf62-3264cb67ee74" returned: 0 in 0.309s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:29:54 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0939991b-ce0a-41dd-953d-1d4e4b94e1b4 tempest-GroupSnapshotsV319Test-1271126008 None] Lock "cinder-quobyte-7af6c9a2-7ff5-4e99-bf62-3264cb67ee74" released by "_delete_snapshot" :: held 2.226s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:29:54 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0939991b-ce0a-41dd-953d-1d4e4b94e1b4 tempest-GroupSnapshotsV319Test-1271126008 None] Lock "cinder-quobyte-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c" released by "delete_snapshot" :: held 2.264s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:29:54 devstack cinder-volume[86703]: WARNING cinder.quota [None req-0939991b-ce0a-41dd-953d-1d4e4b94e1b4 tempest-GroupSnapshotsV319Test-1271126008 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1407265900 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1407265900, it is now deprecated. Please use the default quota class for default quota. Nov 02 15:29:54 devstack cinder-volume[86703]: WARNING cinder.quota [None req-0939991b-ce0a-41dd-953d-1d4e4b94e1b4 tempest-GroupSnapshotsV319Test-1271126008 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1407265900 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1407265900, it is now deprecated. Please use the default quota class for default quota. Nov 02 15:29:54 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-0939991b-ce0a-41dd-953d-1d4e4b94e1b4 tempest-GroupSnapshotsV319Test-1271126008 None] Created reservations ['e8d440e8-0805-45e4-aaab-d8ac41ff29cc', '71d9d0a9-ead3-45ac-bf93-33998e8898cb', '2b590d12-f837-47ca-8d40-c3cd163101fc', 'd1f1295f-7c5b-4107-8716-294729d17122'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:29:54 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-0939991b-ce0a-41dd-953d-1d4e4b94e1b4 tempest-GroupSnapshotsV319Test-1271126008 None] group_snapshot 7e074592-49fd-4daf-a031-ee2651085323: deleted successfully Nov 02 15:29:56 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-e9e61b6b-04d1-46e0-ae77-9266ad8f0c1e tempest-GroupSnapshotsV319Test-1271126008 None] Acquiring lock "cinder-quobyte-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:29:56 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-e9e61b6b-04d1-46e0-ae77-9266ad8f0c1e tempest-GroupSnapshotsV319Test-1271126008 None] Lock "cinder-quobyte-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c" acquired by "delete_volume" :: waited 0.034s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:29:56 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[76456643-136a-4385-bf01-38175007855b]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:29:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e9e61b6b-04d1-46e0-ae77-9266ad8f0c1e tempest-GroupSnapshotsV319Test-1271126008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:29:56 devstack sudo[88643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c Nov 02 15:29:56 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:29:56 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root Nov 02 15:29:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e9e61b6b-04d1-46e0-ae77-9266ad8f0c1e tempest-GroupSnapshotsV319Test-1271126008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c" returned: 0 in 0.410s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:29:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e9e61b6b-04d1-46e0-ae77-9266ad8f0c1e tempest-GroupSnapshotsV319Test-1271126008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:29:56 devstack sudo[88649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c Nov 02 15:29:56 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:29:56 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root Nov 02 15:29:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e9e61b6b-04d1-46e0-ae77-9266ad8f0c1e tempest-GroupSnapshotsV319Test-1271126008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c" returned: 0 in 0.281s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:29:56 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-e9e61b6b-04d1-46e0-ae77-9266ad8f0c1e tempest-GroupSnapshotsV319Test-1271126008 None] Lock "cinder-quobyte-11c4e2dd-1fed-4a0d-9c5e-e1bcb251927c" released by "delete_volume" :: held 0.834s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:29:57 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-e9e61b6b-04d1-46e0-ae77-9266ad8f0c1e tempest-GroupSnapshotsV319Test-1271126008 None] Created reservations ['625c5c63-1b5e-439d-b9ed-63b66a2fbbdd'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:29:57 devstack cinder-volume[86703]: WARNING cinder.quota [None req-e9e61b6b-04d1-46e0-ae77-9266ad8f0c1e tempest-GroupSnapshotsV319Test-1271126008 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1407265900 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1407265900, it is now deprecated. Please use the default quota class for default quota. Nov 02 15:29:57 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-e9e61b6b-04d1-46e0-ae77-9266ad8f0c1e tempest-GroupSnapshotsV319Test-1271126008 None] Created reservations ['a4da833b-2471-4a5c-a63b-2e8cfb10d752', '961d566d-4cd5-4277-ac6a-ced7326c93fc', '8e3cb786-0c43-497a-8169-3f975f548291', '27e82fa3-91bd-49bc-b081-8242b7bb8c72'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:29:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-e9e61b6b-04d1-46e0-ae77-9266ad8f0c1e tempest-GroupSnapshotsV319Test-1271126008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:29:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-e9e61b6b-04d1-46e0-ae77-9266ad8f0c1e tempest-GroupSnapshotsV319Test-1271126008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:29:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-e9e61b6b-04d1-46e0-ae77-9266ad8f0c1e tempest-GroupSnapshotsV319Test-1271126008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:29:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-e9e61b6b-04d1-46e0-ae77-9266ad8f0c1e tempest-GroupSnapshotsV319Test-1271126008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:29:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-e9e61b6b-04d1-46e0-ae77-9266ad8f0c1e tempest-GroupSnapshotsV319Test-1271126008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:29:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e9e61b6b-04d1-46e0-ae77-9266ad8f0c1e tempest-GroupSnapshotsV319Test-1271126008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:29:57 devstack sudo[88652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:29:57 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:29:57 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root Nov 02 15:29:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e9e61b6b-04d1-46e0-ae77-9266ad8f0c1e tempest-GroupSnapshotsV319Test-1271126008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.391s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:29:57 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-e9e61b6b-04d1-46e0-ae77-9266ad8f0c1e tempest-GroupSnapshotsV319Test-1271126008 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:29:57 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-e9e61b6b-04d1-46e0-ae77-9266ad8f0c1e tempest-GroupSnapshotsV319Test-1271126008 None] Delete group completed successfully. Nov 02 15:30:07 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=53,cinder:UPDATE=53,cinder:INSERT=10,cinder:DELETE=3 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:30:14 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=57,cinder:UPDATE=50,cinder:DELETE=3,cinder:INSERT=12 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:30:20 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:30:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:30:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:30:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:30:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:30:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:30:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:20 devstack sudo[89312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:30:20 devstack sudo[89312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:21 devstack sudo[89312]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.539s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:21 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:30:21 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager._thread_info {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:30:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread count: 8 {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 15:30:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread info: [<_MainThread(MainThread, started 125876361756800)>, , , , , , , ] {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 15:30:22 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:30:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] Flow 'volume_create_manager' (84f1d31a-a272-47f9-998a-8203f5ec3d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:30:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6ce654c-36a4-4e7a-b605-bd669eda2137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:30:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6ce654c-36a4-4e7a-b605-bd669eda2137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-894725639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5963a0a4-2b1c-4904-8987-e6f69cd875f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4526aff3c14591a6a92f0439390b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:30:23Z,use_quota=True,user_id='37ab8443d3ac46db96b836f79ec5668e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:30:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20972ae-2593-4461-b72d-a7c98587acbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:30:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20972ae-2593-4461-b72d-a7c98587acbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:30:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (868f9b33-4021-4b26-a5db-0723d3b4634e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:30:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (868f9b33-4021-4b26-a5db-0723d3b4634e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5963a0a4-2b1c-4904-8987-e6f69cd875f5', 'volume_name': 'volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:30:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a368960-34f3-40c8-84bb-96571cff862c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:30:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a368960-34f3-40c8-84bb-96571cff862c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:30:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a418318-80ad-4ae6-98aa-7e06d1797299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:30:22 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] Volume 5963a0a4-2b1c-4904-8987-e6f69cd875f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5', 'volume_size': 1} Nov 02 15:30:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:30:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:30:22 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-894725639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5963a0a4-2b1c-4904-8987-e6f69cd875f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e4526aff3c14591a6a92f0439390b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:30:23Z,use_quota=True,user_id='37ab8443d3ac46db96b836f79ec5668e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:30:22 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] Creating volume 5963a0a4-2b1c-4904-8987-e6f69cd875f5 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:30:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:30:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:30:22 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:30:22 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:30:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:30:22 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:30:22 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:30:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:22 devstack sudo[89341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5 1073741824 Nov 02 15:30:22 devstack sudo[89341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:23 devstack sudo[89341]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5 1073741824" returned: 0 in 0.464s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:23 devstack sudo[89346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5 Nov 02 15:30:23 devstack sudo[89346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:23 devstack sudo[89346]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5" returned: 0 in 0.381s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:23 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:30:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:30:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a418318-80ad-4ae6-98aa-7e06d1797299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:30:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a49c10a-57bd-4e38-be73-38d80bb15d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:30:23 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] Volume volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5 (5963a0a4-2b1c-4904-8987-e6f69cd875f5): created successfully Nov 02 15:30:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a49c10a-57bd-4e38-be73-38d80bb15d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:30:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] Flow 'volume_create_manager' (84f1d31a-a272-47f9-998a-8203f5ec3d09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:30:23 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-1e235099-eea9-493b-895b-454084393059 tempest-SnapshotsActionsTest-686992346 None] Created volume successfully. Nov 02 15:30:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2d97b9d4-5dfc-4135-8b81-8a8e2fd99266 tempest-SnapshotsActionsTest-686992346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:30:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2d97b9d4-5dfc-4135-8b81-8a8e2fd99266 tempest-SnapshotsActionsTest-686992346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:30:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-2d97b9d4-5dfc-4135-8b81-8a8e2fd99266 tempest-SnapshotsActionsTest-686992346 None] Creating offline snapshot 51c570a5-faca-4cff-9760-72252d85fc37 of volume 5963a0a4-2b1c-4904-8987-e6f69cd875f5 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:30:25 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a2a3dc-5a2a-448f-9305-6c88fec9b3b1]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:30:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2d97b9d4-5dfc-4135-8b81-8a8e2fd99266 tempest-SnapshotsActionsTest-686992346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:25 devstack sudo[89350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5 Nov 02 15:30:25 devstack sudo[89350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:25 devstack sudo[89350]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2d97b9d4-5dfc-4135-8b81-8a8e2fd99266 tempest-SnapshotsActionsTest-686992346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5" returned: 0 in 0.523s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2d97b9d4-5dfc-4135-8b81-8a8e2fd99266 tempest-SnapshotsActionsTest-686992346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:25 devstack sudo[89356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 1G Nov 02 15:30:25 devstack sudo[89356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:26 devstack sudo[89356]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2d97b9d4-5dfc-4135-8b81-8a8e2fd99266 tempest-SnapshotsActionsTest-686992346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 1G" returned: 0 in 0.694s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2d97b9d4-5dfc-4135-8b81-8a8e2fd99266 tempest-SnapshotsActionsTest-686992346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:26 devstack sudo[89363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 Nov 02 15:30:26 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:26 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2d97b9d4-5dfc-4135-8b81-8a8e2fd99266 tempest-SnapshotsActionsTest-686992346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37" returned: 0 in 0.372s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:27 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-2d97b9d4-5dfc-4135-8b81-8a8e2fd99266 tempest-SnapshotsActionsTest-686992346 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 is being set with open permissions: ugo+rw Nov 02 15:30:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2d97b9d4-5dfc-4135-8b81-8a8e2fd99266 tempest-SnapshotsActionsTest-686992346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:27 devstack sudo[89368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 Nov 02 15:30:27 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:27 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2d97b9d4-5dfc-4135-8b81-8a8e2fd99266 tempest-SnapshotsActionsTest-686992346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37" returned: 0 in 0.509s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2d97b9d4-5dfc-4135-8b81-8a8e2fd99266 tempest-SnapshotsActionsTest-686992346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:27 devstack sudo[89371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.info Nov 02 15:30:27 devstack sudo[89371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:27 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-8c8bac64-3099-47ab-93cb-cdb12a5ab9aa req-10163069-873d-47c8-8d8e-fccba2b5dcb9 tempest-AttachVolumeTestJSON-1784642411 None] Terminate volume connection completed successfully. Nov 02 15:30:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-8c8bac64-3099-47ab-93cb-cdb12a5ab9aa req-10163069-873d-47c8-8d8e-fccba2b5dcb9 tempest-AttachVolumeTestJSON-1784642411 None] Deleting attachment 351199a1-aeda-4d41-86a6-d66f494b62ca. {{(pid=86703) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 15:30:27 devstack sudo[89371]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2d97b9d4-5dfc-4135-8b81-8a8e2fd99266 tempest-SnapshotsActionsTest-686992346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.info" returned: 0 in 0.366s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:27 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-2d97b9d4-5dfc-4135-8b81-8a8e2fd99266 tempest-SnapshotsActionsTest-686992346 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.info is being set with open permissions: ugo+rw Nov 02 15:30:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2d97b9d4-5dfc-4135-8b81-8a8e2fd99266 tempest-SnapshotsActionsTest-686992346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:27 devstack sudo[89378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.info Nov 02 15:30:27 devstack sudo[89378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:28 devstack sudo[89378]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2d97b9d4-5dfc-4135-8b81-8a8e2fd99266 tempest-SnapshotsActionsTest-686992346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.info" returned: 0 in 0.316s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2d97b9d4-5dfc-4135-8b81-8a8e2fd99266 tempest-SnapshotsActionsTest-686992346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.924s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:30:28 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-2d97b9d4-5dfc-4135-8b81-8a8e2fd99266 tempest-SnapshotsActionsTest-686992346 None] Create snapshot completed successfully Nov 02 15:30:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c1d348b6-1eae-46e5-986d-9d556ea01b2a tempest-SnapshotsActionsTest-686992346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:30:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c1d348b6-1eae-46e5-986d-9d556ea01b2a tempest-SnapshotsActionsTest-686992346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:30:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-c1d348b6-1eae-46e5-986d-9d556ea01b2a tempest-SnapshotsActionsTest-686992346 None] Creating offline snapshot 987b0b5d-fce6-4e7f-9e7d-fdfb7e934d7c of volume 5963a0a4-2b1c-4904-8987-e6f69cd875f5 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:30:29 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[47af1524-c6ff-4333-8c91-5f0f18f7488a]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:30:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c1d348b6-1eae-46e5-986d-9d556ea01b2a tempest-SnapshotsActionsTest-686992346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:29 devstack sudo[89384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 Nov 02 15:30:29 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:30 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c1d348b6-1eae-46e5-986d-9d556ea01b2a tempest-SnapshotsActionsTest-686992346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37" returned: 0 in 0.628s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-c1d348b6-1eae-46e5-986d-9d556ea01b2a tempest-SnapshotsActionsTest-686992346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:30:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c1d348b6-1eae-46e5-986d-9d556ea01b2a tempest-SnapshotsActionsTest-686992346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.987b0b5d-fce6-4e7f-9e7d-fdfb7e934d7c 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:30 devstack sudo[89389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.987b0b5d-fce6-4e7f-9e7d-fdfb7e934d7c 1G Nov 02 15:30:30 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:30 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c1d348b6-1eae-46e5-986d-9d556ea01b2a tempest-SnapshotsActionsTest-686992346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.987b0b5d-fce6-4e7f-9e7d-fdfb7e934d7c 1G" returned: 0 in 0.738s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c1d348b6-1eae-46e5-986d-9d556ea01b2a tempest-SnapshotsActionsTest-686992346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.987b0b5d-fce6-4e7f-9e7d-fdfb7e934d7c {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:31 devstack sudo[89395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.987b0b5d-fce6-4e7f-9e7d-fdfb7e934d7c Nov 02 15:30:31 devstack sudo[89395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:31 devstack sudo[89395]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c1d348b6-1eae-46e5-986d-9d556ea01b2a tempest-SnapshotsActionsTest-686992346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.987b0b5d-fce6-4e7f-9e7d-fdfb7e934d7c" returned: 0 in 0.463s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:31 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-c1d348b6-1eae-46e5-986d-9d556ea01b2a tempest-SnapshotsActionsTest-686992346 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.987b0b5d-fce6-4e7f-9e7d-fdfb7e934d7c is being set with open permissions: ugo+rw Nov 02 15:30:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c1d348b6-1eae-46e5-986d-9d556ea01b2a tempest-SnapshotsActionsTest-686992346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.987b0b5d-fce6-4e7f-9e7d-fdfb7e934d7c {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:31 devstack sudo[89432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.987b0b5d-fce6-4e7f-9e7d-fdfb7e934d7c Nov 02 15:30:31 devstack sudo[89432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:31 devstack sudo[89432]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c1d348b6-1eae-46e5-986d-9d556ea01b2a tempest-SnapshotsActionsTest-686992346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.987b0b5d-fce6-4e7f-9e7d-fdfb7e934d7c" returned: 0 in 0.344s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c1d348b6-1eae-46e5-986d-9d556ea01b2a tempest-SnapshotsActionsTest-686992346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.317s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:30:31 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-c1d348b6-1eae-46e5-986d-9d556ea01b2a tempest-SnapshotsActionsTest-686992346 None] Create snapshot completed successfully Nov 02 15:30:32 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f3afe2ba-1111-4c4d-9b99-9f3d69f5b96f tempest-SnapshotsActionsTest-1019030700 None] Acquiring lock "cinder-987b0b5d-fce6-4e7f-9e7d-fdfb7e934d7c-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:30:32 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f3afe2ba-1111-4c4d-9b99-9f3d69f5b96f tempest-SnapshotsActionsTest-1019030700 None] Lock "cinder-987b0b5d-fce6-4e7f-9e7d-fdfb7e934d7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:30:32 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f3afe2ba-1111-4c4d-9b99-9f3d69f5b96f tempest-SnapshotsActionsTest-1019030700 None] Acquiring lock "cinder-quobyte-5963a0a4-2b1c-4904-8987-e6f69cd875f5" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:30:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f3afe2ba-1111-4c4d-9b99-9f3d69f5b96f tempest-SnapshotsActionsTest-1019030700 None] Lock "cinder-quobyte-5963a0a4-2b1c-4904-8987-e6f69cd875f5" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:30:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f3afe2ba-1111-4c4d-9b99-9f3d69f5b96f tempest-SnapshotsActionsTest-1019030700 None] Acquiring lock "cinder-quobyte-987b0b5d-fce6-4e7f-9e7d-fdfb7e934d7c" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:30:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f3afe2ba-1111-4c4d-9b99-9f3d69f5b96f tempest-SnapshotsActionsTest-1019030700 None] Lock "cinder-quobyte-987b0b5d-fce6-4e7f-9e7d-fdfb7e934d7c" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:30:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-f3afe2ba-1111-4c4d-9b99-9f3d69f5b96f tempest-SnapshotsActionsTest-1019030700 None] Deleting offline snapshot 987b0b5d-fce6-4e7f-9e7d-fdfb7e934d7c of volume 5963a0a4-2b1c-4904-8987-e6f69cd875f5 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:30:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-f3afe2ba-1111-4c4d-9b99-9f3d69f5b96f tempest-SnapshotsActionsTest-1019030700 None] snapshot_file for this snap is: volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.987b0b5d-fce6-4e7f-9e7d-fdfb7e934d7c {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:30:33 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a11a25-7eac-4e3f-b92e-18c290f96425]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:30:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f3afe2ba-1111-4c4d-9b99-9f3d69f5b96f tempest-SnapshotsActionsTest-1019030700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.987b0b5d-fce6-4e7f-9e7d-fdfb7e934d7c {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:33 devstack sudo[89480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.987b0b5d-fce6-4e7f-9e7d-fdfb7e934d7c Nov 02 15:30:33 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:33 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f3afe2ba-1111-4c4d-9b99-9f3d69f5b96f tempest-SnapshotsActionsTest-1019030700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.987b0b5d-fce6-4e7f-9e7d-fdfb7e934d7c" returned: 0 in 0.712s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-f3afe2ba-1111-4c4d-9b99-9f3d69f5b96f tempest-SnapshotsActionsTest-1019030700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:30:33 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3417322-ddfa-4fc0-91c5-4785d094f801]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:30:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f3afe2ba-1111-4c4d-9b99-9f3d69f5b96f tempest-SnapshotsActionsTest-1019030700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:34 devstack sudo[89532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 Nov 02 15:30:34 devstack sudo[89532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:34 devstack sudo[89532]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f3afe2ba-1111-4c4d-9b99-9f3d69f5b96f tempest-SnapshotsActionsTest-1019030700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37" returned: 0 in 0.586s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:34 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-f3afe2ba-1111-4c4d-9b99-9f3d69f5b96f tempest-SnapshotsActionsTest-1019030700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:30:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f3afe2ba-1111-4c4d-9b99-9f3d69f5b96f tempest-SnapshotsActionsTest-1019030700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.987b0b5d-fce6-4e7f-9e7d-fdfb7e934d7c {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:34 devstack sudo[89541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.987b0b5d-fce6-4e7f-9e7d-fdfb7e934d7c Nov 02 15:30:34 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:35 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f3afe2ba-1111-4c4d-9b99-9f3d69f5b96f tempest-SnapshotsActionsTest-1019030700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.987b0b5d-fce6-4e7f-9e7d-fdfb7e934d7c" returned: 0 in 0.527s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f3afe2ba-1111-4c4d-9b99-9f3d69f5b96f tempest-SnapshotsActionsTest-1019030700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.987b0b5d-fce6-4e7f-9e7d-fdfb7e934d7c {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:35 devstack sudo[89548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.987b0b5d-fce6-4e7f-9e7d-fdfb7e934d7c Nov 02 15:30:35 devstack sudo[89548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:35 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:30:35 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] Flow 'volume_create_manager' (8034d437-3885-4cae-aacb-ad133962a9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:30:35 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2920759a-fa98-49c2-94e6-a3a70553deb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:30:35 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2920759a-fa98-49c2-94e6-a3a70553deb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1351187977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a25bc2-10e8-401a-8132-6aface103f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e497c4a4de94b8ba427e788815c33d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:30:35Z,use_quota=True,user_id='ecd0a0db93df4e92979a5433007c1e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:30:35 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08a8e354-2d7e-4116-8fd4-90fe68799525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:30:35 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08a8e354-2d7e-4116-8fd4-90fe68799525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:30:35 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c741d4a2-8d7a-4d26-9b83-8c63fb501b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:30:35 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c741d4a2-8d7a-4d26-9b83-8c63fb501b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9a25bc2-10e8-401a-8132-6aface103f97', 'volume_name': 'volume-b9a25bc2-10e8-401a-8132-6aface103f97', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:30:35 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af701c4b-5493-4abf-aca3-1253d6fb4c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:30:35 devstack sudo[89548]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:35 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af701c4b-5493-4abf-aca3-1253d6fb4c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:30:35 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (180da6a8-3960-426e-822e-f75541e537ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:30:35 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] Volume b9a25bc2-10e8-401a-8132-6aface103f97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9a25bc2-10e8-401a-8132-6aface103f97', 'volume_size': 1} Nov 02 15:30:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:30:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:30:35 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1351187977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9a25bc2-10e8-401a-8132-6aface103f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e497c4a4de94b8ba427e788815c33d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:30:35Z,use_quota=True,user_id='ecd0a0db93df4e92979a5433007c1e0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:30:35 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] Creating volume b9a25bc2-10e8-401a-8132-6aface103f97 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:30:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:30:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:30:35 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:30:35 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:30:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:30:35 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:30:35 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:30:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b9a25bc2-10e8-401a-8132-6aface103f97 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f3afe2ba-1111-4c4d-9b99-9f3d69f5b96f tempest-SnapshotsActionsTest-1019030700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.987b0b5d-fce6-4e7f-9e7d-fdfb7e934d7c" returned: 0 in 0.326s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:35 devstack sudo[89551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b9a25bc2-10e8-401a-8132-6aface103f97 1073741824 Nov 02 15:30:35 devstack sudo[89551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f3afe2ba-1111-4c4d-9b99-9f3d69f5b96f tempest-SnapshotsActionsTest-1019030700 None] Lock "cinder-quobyte-987b0b5d-fce6-4e7f-9e7d-fdfb7e934d7c" released by "_delete_snapshot" :: held 2.342s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:30:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f3afe2ba-1111-4c4d-9b99-9f3d69f5b96f tempest-SnapshotsActionsTest-1019030700 None] Lock "cinder-quobyte-5963a0a4-2b1c-4904-8987-e6f69cd875f5" released by "delete_snapshot" :: held 2.411s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:30:35 devstack cinder-volume[86703]: WARNING cinder.quota [None req-f3afe2ba-1111-4c4d-9b99-9f3d69f5b96f tempest-SnapshotsActionsTest-1019030700 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 02 15:30:35 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-f3afe2ba-1111-4c4d-9b99-9f3d69f5b96f tempest-SnapshotsActionsTest-1019030700 None] Created reservations ['dda9d999-9a6d-4ec2-9070-bffbb53d1362', '29872352-d3f5-40c0-9506-8a76180d397d', 'ccae87a6-755e-4645-80b6-28b11fe337cd', '937624c3-9b23-47ab-9563-20316bf1eccf'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:30:35 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-f3afe2ba-1111-4c4d-9b99-9f3d69f5b96f tempest-SnapshotsActionsTest-1019030700 None] Delete snapshot completed successfully. Nov 02 15:30:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f3afe2ba-1111-4c4d-9b99-9f3d69f5b96f tempest-SnapshotsActionsTest-1019030700 None] Lock "cinder-987b0b5d-fce6-4e7f-9e7d-fdfb7e934d7c-delete_snapshot" released by "delete_snapshot" :: held 2.630s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:30:35 devstack sudo[89551]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b9a25bc2-10e8-401a-8132-6aface103f97 1073741824" returned: 0 in 0.489s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b9a25bc2-10e8-401a-8132-6aface103f97 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:35 devstack sudo[89557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b9a25bc2-10e8-401a-8132-6aface103f97 Nov 02 15:30:35 devstack sudo[89557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:36 devstack sudo[89557]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b9a25bc2-10e8-401a-8132-6aface103f97" returned: 0 in 0.281s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:36 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:30:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:30:36 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (180da6a8-3960-426e-822e-f75541e537ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9a25bc2-10e8-401a-8132-6aface103f97', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:30:36 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4712cf07-98aa-4494-aea5-e352ce713349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:30:36 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] Volume volume-b9a25bc2-10e8-401a-8132-6aface103f97 (b9a25bc2-10e8-401a-8132-6aface103f97): created successfully Nov 02 15:30:36 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4712cf07-98aa-4494-aea5-e352ce713349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:30:36 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] Flow 'volume_create_manager' (8034d437-3885-4cae-aacb-ad133962a9f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:30:36 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-e1f4a1d3-3d39-426c-be21-f3999c200a4a tempest-TaggedAttachmentsTest-352889208 None] Created volume successfully. Nov 02 15:30:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-6982c5be-ad7e-4cc0-bcac-a7a28ce21e7a tempest-SnapshotsActionsTest-686992346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:30:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-6982c5be-ad7e-4cc0-bcac-a7a28ce21e7a tempest-SnapshotsActionsTest-686992346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:30:36 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-6982c5be-ad7e-4cc0-bcac-a7a28ce21e7a tempest-SnapshotsActionsTest-686992346 None] Creating offline snapshot a1cedb5c-9550-4a80-a3f1-2e7a8bfd40a6 of volume 5963a0a4-2b1c-4904-8987-e6f69cd875f5 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:30:36 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edeeddd-e6cb-415f-afa4-7ae952fcc0a2]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:30:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6982c5be-ad7e-4cc0-bcac-a7a28ce21e7a tempest-SnapshotsActionsTest-686992346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:36 devstack sudo[89560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 Nov 02 15:30:36 devstack sudo[89560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:36 devstack sudo[89560]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6982c5be-ad7e-4cc0-bcac-a7a28ce21e7a tempest-SnapshotsActionsTest-686992346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37" returned: 0 in 0.377s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:36 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-6982c5be-ad7e-4cc0-bcac-a7a28ce21e7a tempest-SnapshotsActionsTest-686992346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:30:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6982c5be-ad7e-4cc0-bcac-a7a28ce21e7a tempest-SnapshotsActionsTest-686992346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.a1cedb5c-9550-4a80-a3f1-2e7a8bfd40a6 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:36 devstack sudo[89565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.a1cedb5c-9550-4a80-a3f1-2e7a8bfd40a6 1G Nov 02 15:30:36 devstack sudo[89565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:37 devstack sudo[89565]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6982c5be-ad7e-4cc0-bcac-a7a28ce21e7a tempest-SnapshotsActionsTest-686992346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.a1cedb5c-9550-4a80-a3f1-2e7a8bfd40a6 1G" returned: 0 in 0.504s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6982c5be-ad7e-4cc0-bcac-a7a28ce21e7a tempest-SnapshotsActionsTest-686992346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.a1cedb5c-9550-4a80-a3f1-2e7a8bfd40a6 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:37 devstack sudo[89572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.a1cedb5c-9550-4a80-a3f1-2e7a8bfd40a6 Nov 02 15:30:37 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:37 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6982c5be-ad7e-4cc0-bcac-a7a28ce21e7a tempest-SnapshotsActionsTest-686992346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.a1cedb5c-9550-4a80-a3f1-2e7a8bfd40a6" returned: 0 in 0.362s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:37 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-6982c5be-ad7e-4cc0-bcac-a7a28ce21e7a tempest-SnapshotsActionsTest-686992346 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.a1cedb5c-9550-4a80-a3f1-2e7a8bfd40a6 is being set with open permissions: ugo+rw Nov 02 15:30:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6982c5be-ad7e-4cc0-bcac-a7a28ce21e7a tempest-SnapshotsActionsTest-686992346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.a1cedb5c-9550-4a80-a3f1-2e7a8bfd40a6 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:37 devstack sudo[89578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.a1cedb5c-9550-4a80-a3f1-2e7a8bfd40a6 Nov 02 15:30:37 devstack sudo[89578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:38 devstack sudo[89578]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6982c5be-ad7e-4cc0-bcac-a7a28ce21e7a tempest-SnapshotsActionsTest-686992346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.a1cedb5c-9550-4a80-a3f1-2e7a8bfd40a6" returned: 0 in 0.299s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-6982c5be-ad7e-4cc0-bcac-a7a28ce21e7a tempest-SnapshotsActionsTest-686992346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.663s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:30:38 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-6982c5be-ad7e-4cc0-bcac-a7a28ce21e7a tempest-SnapshotsActionsTest-686992346 None] Create snapshot completed successfully Nov 02 15:30:38 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-93e09ec3-ba6e-49f5-89e2-af649fb7765d tempest-SnapshotsActionsTest-1019030700 None] Acquiring lock "cinder-a1cedb5c-9550-4a80-a3f1-2e7a8bfd40a6-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:30:38 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-93e09ec3-ba6e-49f5-89e2-af649fb7765d tempest-SnapshotsActionsTest-1019030700 None] Lock "cinder-a1cedb5c-9550-4a80-a3f1-2e7a8bfd40a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:30:38 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-93e09ec3-ba6e-49f5-89e2-af649fb7765d tempest-SnapshotsActionsTest-1019030700 None] Acquiring lock "cinder-quobyte-5963a0a4-2b1c-4904-8987-e6f69cd875f5" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:30:38 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-93e09ec3-ba6e-49f5-89e2-af649fb7765d tempest-SnapshotsActionsTest-1019030700 None] Lock "cinder-quobyte-5963a0a4-2b1c-4904-8987-e6f69cd875f5" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:30:38 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-93e09ec3-ba6e-49f5-89e2-af649fb7765d tempest-SnapshotsActionsTest-1019030700 None] Acquiring lock "cinder-quobyte-a1cedb5c-9550-4a80-a3f1-2e7a8bfd40a6" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:30:38 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-93e09ec3-ba6e-49f5-89e2-af649fb7765d tempest-SnapshotsActionsTest-1019030700 None] Lock "cinder-quobyte-a1cedb5c-9550-4a80-a3f1-2e7a8bfd40a6" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:30:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-93e09ec3-ba6e-49f5-89e2-af649fb7765d tempest-SnapshotsActionsTest-1019030700 None] Deleting offline snapshot a1cedb5c-9550-4a80-a3f1-2e7a8bfd40a6 of volume 5963a0a4-2b1c-4904-8987-e6f69cd875f5 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:30:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-93e09ec3-ba6e-49f5-89e2-af649fb7765d tempest-SnapshotsActionsTest-1019030700 None] snapshot_file for this snap is: volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.a1cedb5c-9550-4a80-a3f1-2e7a8bfd40a6 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:30:38 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c09862-579a-4f52-8536-837b6cd4c36c]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:30:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-93e09ec3-ba6e-49f5-89e2-af649fb7765d tempest-SnapshotsActionsTest-1019030700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.a1cedb5c-9550-4a80-a3f1-2e7a8bfd40a6 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:39 devstack sudo[89581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.a1cedb5c-9550-4a80-a3f1-2e7a8bfd40a6 Nov 02 15:30:39 devstack sudo[89581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:39 devstack sudo[89581]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-93e09ec3-ba6e-49f5-89e2-af649fb7765d tempest-SnapshotsActionsTest-1019030700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.a1cedb5c-9550-4a80-a3f1-2e7a8bfd40a6" returned: 0 in 0.507s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:39 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-93e09ec3-ba6e-49f5-89e2-af649fb7765d tempest-SnapshotsActionsTest-1019030700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:30:39 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9220a035-6f61-42ed-86f4-238227d79e54]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:30:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-93e09ec3-ba6e-49f5-89e2-af649fb7765d tempest-SnapshotsActionsTest-1019030700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:39 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 Nov 02 15:30:39 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:39 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-93e09ec3-ba6e-49f5-89e2-af649fb7765d tempest-SnapshotsActionsTest-1019030700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37" returned: 0 in 0.458s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:39 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-93e09ec3-ba6e-49f5-89e2-af649fb7765d tempest-SnapshotsActionsTest-1019030700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:30:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-93e09ec3-ba6e-49f5-89e2-af649fb7765d tempest-SnapshotsActionsTest-1019030700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.a1cedb5c-9550-4a80-a3f1-2e7a8bfd40a6 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:39 devstack sudo[89592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.a1cedb5c-9550-4a80-a3f1-2e7a8bfd40a6 Nov 02 15:30:39 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:40 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-93e09ec3-ba6e-49f5-89e2-af649fb7765d tempest-SnapshotsActionsTest-1019030700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.a1cedb5c-9550-4a80-a3f1-2e7a8bfd40a6" returned: 0 in 0.390s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-93e09ec3-ba6e-49f5-89e2-af649fb7765d tempest-SnapshotsActionsTest-1019030700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.a1cedb5c-9550-4a80-a3f1-2e7a8bfd40a6 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:40 devstack sudo[89598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.a1cedb5c-9550-4a80-a3f1-2e7a8bfd40a6 Nov 02 15:30:40 devstack sudo[89598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:40 devstack sudo[89598]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-93e09ec3-ba6e-49f5-89e2-af649fb7765d tempest-SnapshotsActionsTest-1019030700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.a1cedb5c-9550-4a80-a3f1-2e7a8bfd40a6" returned: 0 in 0.385s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-93e09ec3-ba6e-49f5-89e2-af649fb7765d tempest-SnapshotsActionsTest-1019030700 None] Lock "cinder-quobyte-a1cedb5c-9550-4a80-a3f1-2e7a8bfd40a6" released by "_delete_snapshot" :: held 1.869s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:30:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-93e09ec3-ba6e-49f5-89e2-af649fb7765d tempest-SnapshotsActionsTest-1019030700 None] Lock "cinder-quobyte-5963a0a4-2b1c-4904-8987-e6f69cd875f5" released by "delete_snapshot" :: held 1.909s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:30:40 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-93e09ec3-ba6e-49f5-89e2-af649fb7765d tempest-SnapshotsActionsTest-1019030700 None] Created reservations ['d982d759-bd18-480e-b701-5713150dede5', '61a728e2-b2be-48d4-8ea9-88c52d6b490c', 'eff33c3f-4c5b-4f8f-83fa-f9ca66c15854', '71eba7a9-ffd9-4723-9e2f-0e661d77ab14'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:30:40 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-93e09ec3-ba6e-49f5-89e2-af649fb7765d tempest-SnapshotsActionsTest-1019030700 None] Delete snapshot completed successfully. Nov 02 15:30:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-93e09ec3-ba6e-49f5-89e2-af649fb7765d tempest-SnapshotsActionsTest-1019030700 None] Lock "cinder-a1cedb5c-9550-4a80-a3f1-2e7a8bfd40a6-delete_snapshot" released by "delete_snapshot" :: held 2.148s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:30:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-13c128f4-870d-487e-9cbd-6d6ca771a41f tempest-SnapshotsActionsTest-686992346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:30:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-13c128f4-870d-487e-9cbd-6d6ca771a41f tempest-SnapshotsActionsTest-686992346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:30:41 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-13c128f4-870d-487e-9cbd-6d6ca771a41f tempest-SnapshotsActionsTest-686992346 None] Creating offline snapshot 66bb7cf8-726d-4e99-94ef-17a035f85907 of volume 5963a0a4-2b1c-4904-8987-e6f69cd875f5 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:30:41 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[342060ea-b0eb-4829-8ef1-405ded47b855]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:30:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-13c128f4-870d-487e-9cbd-6d6ca771a41f tempest-SnapshotsActionsTest-686992346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:41 devstack sudo[89606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 Nov 02 15:30:41 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:42 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-13c128f4-870d-487e-9cbd-6d6ca771a41f tempest-SnapshotsActionsTest-686992346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37" returned: 0 in 0.424s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:42 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-13c128f4-870d-487e-9cbd-6d6ca771a41f tempest-SnapshotsActionsTest-686992346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:30:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-13c128f4-870d-487e-9cbd-6d6ca771a41f tempest-SnapshotsActionsTest-686992346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.66bb7cf8-726d-4e99-94ef-17a035f85907 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:42 devstack sudo[89612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.66bb7cf8-726d-4e99-94ef-17a035f85907 1G Nov 02 15:30:42 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:42 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:30:42 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] Flow 'volume_create_manager' (a85e5770-f9de-4791-b41c-80665913a89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:30:42 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc1eb3b-1462-4518-b270-849f03dd14b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:30:42 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cc1eb3b-1462-4518-b270-849f03dd14b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-878632001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f58cae23-88e1-4190-ab35-fe097b8f0861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80826bc171e9481ea36abd9838f48b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:30:42Z,use_quota=True,user_id='796346940ff04fc89c2d39cc3c1b247c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:30:42 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d6f4bc4-6d42-4286-9e6f-a8cd835d68dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:30:42 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d6f4bc4-6d42-4286-9e6f-a8cd835d68dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:30:42 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c576d72-c11a-422a-836d-37fc84c4ffe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:30:42 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c576d72-c11a-422a-836d-37fc84c4ffe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f58cae23-88e1-4190-ab35-fe097b8f0861', 'volume_name': 'volume-f58cae23-88e1-4190-ab35-fe097b8f0861', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:30:42 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (946d6b1e-4993-4030-bd7b-448b21cf2b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:30:42 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (946d6b1e-4993-4030-bd7b-448b21cf2b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:30:42 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553ce266-579b-45a0-86a5-521b8ebf40c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:30:42 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] Volume f58cae23-88e1-4190-ab35-fe097b8f0861: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f58cae23-88e1-4190-ab35-fe097b8f0861', 'volume_size': 1} Nov 02 15:30:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:30:42 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-13c128f4-870d-487e-9cbd-6d6ca771a41f tempest-SnapshotsActionsTest-686992346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.66bb7cf8-726d-4e99-94ef-17a035f85907 1G" returned: 0 in 0.719s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-13c128f4-870d-487e-9cbd-6d6ca771a41f tempest-SnapshotsActionsTest-686992346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.66bb7cf8-726d-4e99-94ef-17a035f85907 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:42 devstack sudo[89618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.66bb7cf8-726d-4e99-94ef-17a035f85907 Nov 02 15:30:42 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:43 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-13c128f4-870d-487e-9cbd-6d6ca771a41f tempest-SnapshotsActionsTest-686992346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.66bb7cf8-726d-4e99-94ef-17a035f85907" returned: 0 in 0.404s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:43 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-13c128f4-870d-487e-9cbd-6d6ca771a41f tempest-SnapshotsActionsTest-686992346 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.66bb7cf8-726d-4e99-94ef-17a035f85907 is being set with open permissions: ugo+rw Nov 02 15:30:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-13c128f4-870d-487e-9cbd-6d6ca771a41f tempest-SnapshotsActionsTest-686992346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.66bb7cf8-726d-4e99-94ef-17a035f85907 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:43 devstack sudo[89626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.66bb7cf8-726d-4e99-94ef-17a035f85907 Nov 02 15:30:43 devstack sudo[89626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:43 devstack sudo[89626]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-13c128f4-870d-487e-9cbd-6d6ca771a41f tempest-SnapshotsActionsTest-686992346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.66bb7cf8-726d-4e99-94ef-17a035f85907" returned: 0 in 0.332s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-13c128f4-870d-487e-9cbd-6d6ca771a41f tempest-SnapshotsActionsTest-686992346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.096s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:30:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.993s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:30:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-878632001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f58cae23-88e1-4190-ab35-fe097b8f0861,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80826bc171e9481ea36abd9838f48b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:30:42Z,use_quota=True,user_id='796346940ff04fc89c2d39cc3c1b247c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:30:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] Creating volume f58cae23-88e1-4190-ab35-fe097b8f0861 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:30:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:30:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:30:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:30:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:30:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:30:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:30:43 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:30:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f58cae23-88e1-4190-ab35-fe097b8f0861 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:43 devstack sudo[89637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f58cae23-88e1-4190-ab35-fe097b8f0861 1073741824 Nov 02 15:30:43 devstack sudo[89637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:43 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-13c128f4-870d-487e-9cbd-6d6ca771a41f tempest-SnapshotsActionsTest-686992346 None] Create snapshot completed successfully Nov 02 15:30:44 devstack sudo[89637]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f58cae23-88e1-4190-ab35-fe097b8f0861 1073741824" returned: 0 in 0.728s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f58cae23-88e1-4190-ab35-fe097b8f0861 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:44 devstack sudo[89649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f58cae23-88e1-4190-ab35-fe097b8f0861 Nov 02 15:30:44 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:44 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f58cae23-88e1-4190-ab35-fe097b8f0861" returned: 0 in 0.478s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:44 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:30:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:30:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553ce266-579b-45a0-86a5-521b8ebf40c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f58cae23-88e1-4190-ab35-fe097b8f0861', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:30:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a991aa4-5375-4624-94d7-f70a4aba72bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:30:44 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-85773679-ff0e-4d44-a64d-d711719930c2 tempest-SnapshotsActionsTest-1019030700 None] Acquiring lock "cinder-66bb7cf8-726d-4e99-94ef-17a035f85907-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:30:45 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] Volume volume-f58cae23-88e1-4190-ab35-fe097b8f0861 (f58cae23-88e1-4190-ab35-fe097b8f0861): created successfully Nov 02 15:30:45 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a991aa4-5375-4624-94d7-f70a4aba72bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:30:45 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] Flow 'volume_create_manager' (a85e5770-f9de-4791-b41c-80665913a89a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:30:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-85773679-ff0e-4d44-a64d-d711719930c2 tempest-SnapshotsActionsTest-1019030700 None] Lock "cinder-66bb7cf8-726d-4e99-94ef-17a035f85907-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:30:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-85773679-ff0e-4d44-a64d-d711719930c2 tempest-SnapshotsActionsTest-1019030700 None] Acquiring lock "cinder-quobyte-5963a0a4-2b1c-4904-8987-e6f69cd875f5" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:30:45 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-d78d1bdf-e3bc-4f68-a7d1-50188c5c2fbe tempest-ServerActionsTestOtherA-1672913331 None] Created volume successfully. Nov 02 15:30:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-85773679-ff0e-4d44-a64d-d711719930c2 tempest-SnapshotsActionsTest-1019030700 None] Lock "cinder-quobyte-5963a0a4-2b1c-4904-8987-e6f69cd875f5" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:30:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-85773679-ff0e-4d44-a64d-d711719930c2 tempest-SnapshotsActionsTest-1019030700 None] Acquiring lock "cinder-quobyte-66bb7cf8-726d-4e99-94ef-17a035f85907" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:30:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-85773679-ff0e-4d44-a64d-d711719930c2 tempest-SnapshotsActionsTest-1019030700 None] Lock "cinder-quobyte-66bb7cf8-726d-4e99-94ef-17a035f85907" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:30:45 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-85773679-ff0e-4d44-a64d-d711719930c2 tempest-SnapshotsActionsTest-1019030700 None] Deleting offline snapshot 66bb7cf8-726d-4e99-94ef-17a035f85907 of volume 5963a0a4-2b1c-4904-8987-e6f69cd875f5 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:30:45 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-85773679-ff0e-4d44-a64d-d711719930c2 tempest-SnapshotsActionsTest-1019030700 None] snapshot_file for this snap is: volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.66bb7cf8-726d-4e99-94ef-17a035f85907 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:30:45 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab2519d-86ad-42ec-a425-e0b22e25a548]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:30:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-85773679-ff0e-4d44-a64d-d711719930c2 tempest-SnapshotsActionsTest-1019030700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.66bb7cf8-726d-4e99-94ef-17a035f85907 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:45 devstack sudo[89653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.66bb7cf8-726d-4e99-94ef-17a035f85907 Nov 02 15:30:45 devstack sudo[89653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:45 devstack sudo[89653]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-85773679-ff0e-4d44-a64d-d711719930c2 tempest-SnapshotsActionsTest-1019030700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.66bb7cf8-726d-4e99-94ef-17a035f85907" returned: 0 in 0.511s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:45 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-85773679-ff0e-4d44-a64d-d711719930c2 tempest-SnapshotsActionsTest-1019030700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:30:45 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5df810-9a16-404d-ab1c-0da434f2215c]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:30:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-85773679-ff0e-4d44-a64d-d711719930c2 tempest-SnapshotsActionsTest-1019030700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:46 devstack sudo[89694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 Nov 02 15:30:46 devstack sudo[89694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:46 devstack sudo[89694]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-85773679-ff0e-4d44-a64d-d711719930c2 tempest-SnapshotsActionsTest-1019030700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37" returned: 0 in 0.781s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:46 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-85773679-ff0e-4d44-a64d-d711719930c2 tempest-SnapshotsActionsTest-1019030700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:30:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-85773679-ff0e-4d44-a64d-d711719930c2 tempest-SnapshotsActionsTest-1019030700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.66bb7cf8-726d-4e99-94ef-17a035f85907 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:46 devstack sudo[89702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.66bb7cf8-726d-4e99-94ef-17a035f85907 Nov 02 15:30:46 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:47 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-85773679-ff0e-4d44-a64d-d711719930c2 tempest-SnapshotsActionsTest-1019030700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.66bb7cf8-726d-4e99-94ef-17a035f85907" returned: 0 in 0.525s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-85773679-ff0e-4d44-a64d-d711719930c2 tempest-SnapshotsActionsTest-1019030700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.66bb7cf8-726d-4e99-94ef-17a035f85907 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:47 devstack sudo[89711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.66bb7cf8-726d-4e99-94ef-17a035f85907 Nov 02 15:30:47 devstack sudo[89711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:47 devstack sudo[89711]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-85773679-ff0e-4d44-a64d-d711719930c2 tempest-SnapshotsActionsTest-1019030700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.66bb7cf8-726d-4e99-94ef-17a035f85907" returned: 0 in 0.441s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:47 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-85773679-ff0e-4d44-a64d-d711719930c2 tempest-SnapshotsActionsTest-1019030700 None] Lock "cinder-quobyte-66bb7cf8-726d-4e99-94ef-17a035f85907" released by "_delete_snapshot" :: held 2.474s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:30:47 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-85773679-ff0e-4d44-a64d-d711719930c2 tempest-SnapshotsActionsTest-1019030700 None] Lock "cinder-quobyte-5963a0a4-2b1c-4904-8987-e6f69cd875f5" released by "delete_snapshot" :: held 2.507s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:30:47 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-85773679-ff0e-4d44-a64d-d711719930c2 tempest-SnapshotsActionsTest-1019030700 None] Created reservations ['7063f0ac-9cc0-470d-bab0-6cf1a8425e41', 'aef348aa-b8e7-4f40-898b-f03924e27312', '22dd2e60-d49d-47ee-99c4-0dd99c903542', '66eb963f-a041-4bc3-afbc-c7901dafa12d'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:30:47 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-85773679-ff0e-4d44-a64d-d711719930c2 tempest-SnapshotsActionsTest-1019030700 None] Delete snapshot completed successfully. Nov 02 15:30:47 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-85773679-ff0e-4d44-a64d-d711719930c2 tempest-SnapshotsActionsTest-1019030700 None] Lock "cinder-66bb7cf8-726d-4e99-94ef-17a035f85907-delete_snapshot" released by "delete_snapshot" :: held 2.730s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:30:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-391a8604-a4da-4462-a204-a68b678f4426 tempest-SnapshotsActionsTest-686992346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:30:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-391a8604-a4da-4462-a204-a68b678f4426 tempest-SnapshotsActionsTest-686992346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:30:48 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-391a8604-a4da-4462-a204-a68b678f4426 tempest-SnapshotsActionsTest-686992346 None] Creating offline snapshot 13e299da-8ec6-4072-8f66-ddb14af93732 of volume 5963a0a4-2b1c-4904-8987-e6f69cd875f5 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:30:48 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cc6414-8759-44e8-a974-250a109ccb72]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:30:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-391a8604-a4da-4462-a204-a68b678f4426 tempest-SnapshotsActionsTest-686992346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:49 devstack sudo[89785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 Nov 02 15:30:49 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:49 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-391a8604-a4da-4462-a204-a68b678f4426 tempest-SnapshotsActionsTest-686992346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37" returned: 0 in 0.474s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-391a8604-a4da-4462-a204-a68b678f4426 tempest-SnapshotsActionsTest-686992346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:30:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-391a8604-a4da-4462-a204-a68b678f4426 tempest-SnapshotsActionsTest-686992346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.13e299da-8ec6-4072-8f66-ddb14af93732 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:49 devstack sudo[89791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.13e299da-8ec6-4072-8f66-ddb14af93732 1G Nov 02 15:30:49 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:50 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-391a8604-a4da-4462-a204-a68b678f4426 tempest-SnapshotsActionsTest-686992346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.13e299da-8ec6-4072-8f66-ddb14af93732 1G" returned: 0 in 0.654s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-391a8604-a4da-4462-a204-a68b678f4426 tempest-SnapshotsActionsTest-686992346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.13e299da-8ec6-4072-8f66-ddb14af93732 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:50 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.13e299da-8ec6-4072-8f66-ddb14af93732 Nov 02 15:30:50 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:50 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-391a8604-a4da-4462-a204-a68b678f4426 tempest-SnapshotsActionsTest-686992346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.13e299da-8ec6-4072-8f66-ddb14af93732" returned: 0 in 0.357s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:50 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-391a8604-a4da-4462-a204-a68b678f4426 tempest-SnapshotsActionsTest-686992346 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.13e299da-8ec6-4072-8f66-ddb14af93732 is being set with open permissions: ugo+rw Nov 02 15:30:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-391a8604-a4da-4462-a204-a68b678f4426 tempest-SnapshotsActionsTest-686992346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.13e299da-8ec6-4072-8f66-ddb14af93732 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:50 devstack sudo[89803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.13e299da-8ec6-4072-8f66-ddb14af93732 Nov 02 15:30:50 devstack sudo[89803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:50 devstack sudo[89803]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-391a8604-a4da-4462-a204-a68b678f4426 tempest-SnapshotsActionsTest-686992346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.13e299da-8ec6-4072-8f66-ddb14af93732" returned: 0 in 0.293s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-391a8604-a4da-4462-a204-a68b678f4426 tempest-SnapshotsActionsTest-686992346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.929s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:30:50 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-391a8604-a4da-4462-a204-a68b678f4426 tempest-SnapshotsActionsTest-686992346 None] Create snapshot completed successfully Nov 02 15:30:51 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-72a467eb-6c47-42ac-b1eb-31cb60d162c3 tempest-SnapshotsActionsTest-1019030700 None] Acquiring lock "cinder-13e299da-8ec6-4072-8f66-ddb14af93732-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:30:51 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-72a467eb-6c47-42ac-b1eb-31cb60d162c3 tempest-SnapshotsActionsTest-1019030700 None] Lock "cinder-13e299da-8ec6-4072-8f66-ddb14af93732-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:30:51 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-72a467eb-6c47-42ac-b1eb-31cb60d162c3 tempest-SnapshotsActionsTest-1019030700 None] Acquiring lock "cinder-quobyte-5963a0a4-2b1c-4904-8987-e6f69cd875f5" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:30:51 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-72a467eb-6c47-42ac-b1eb-31cb60d162c3 tempest-SnapshotsActionsTest-1019030700 None] Lock "cinder-quobyte-5963a0a4-2b1c-4904-8987-e6f69cd875f5" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:30:51 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-72a467eb-6c47-42ac-b1eb-31cb60d162c3 tempest-SnapshotsActionsTest-1019030700 None] Acquiring lock "cinder-quobyte-13e299da-8ec6-4072-8f66-ddb14af93732" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:30:51 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-72a467eb-6c47-42ac-b1eb-31cb60d162c3 tempest-SnapshotsActionsTest-1019030700 None] Lock "cinder-quobyte-13e299da-8ec6-4072-8f66-ddb14af93732" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:30:51 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-72a467eb-6c47-42ac-b1eb-31cb60d162c3 tempest-SnapshotsActionsTest-1019030700 None] Deleting offline snapshot 13e299da-8ec6-4072-8f66-ddb14af93732 of volume 5963a0a4-2b1c-4904-8987-e6f69cd875f5 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:30:51 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-72a467eb-6c47-42ac-b1eb-31cb60d162c3 tempest-SnapshotsActionsTest-1019030700 None] snapshot_file for this snap is: volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.13e299da-8ec6-4072-8f66-ddb14af93732 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:30:51 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ea564b-c11a-479c-a8ad-8f8eb67d5f14]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:30:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-72a467eb-6c47-42ac-b1eb-31cb60d162c3 tempest-SnapshotsActionsTest-1019030700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.13e299da-8ec6-4072-8f66-ddb14af93732 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:51 devstack sudo[89822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.13e299da-8ec6-4072-8f66-ddb14af93732 Nov 02 15:30:51 devstack sudo[89822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:51 devstack sudo[89822]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-72a467eb-6c47-42ac-b1eb-31cb60d162c3 tempest-SnapshotsActionsTest-1019030700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.13e299da-8ec6-4072-8f66-ddb14af93732" returned: 0 in 0.570s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:51 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-72a467eb-6c47-42ac-b1eb-31cb60d162c3 tempest-SnapshotsActionsTest-1019030700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:30:51 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f44254e-c013-44dd-b3d2-ecbf587f431d]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:30:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-72a467eb-6c47-42ac-b1eb-31cb60d162c3 tempest-SnapshotsActionsTest-1019030700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:52 devstack sudo[89827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 Nov 02 15:30:52 devstack sudo[89827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:52 devstack sudo[89827]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-72a467eb-6c47-42ac-b1eb-31cb60d162c3 tempest-SnapshotsActionsTest-1019030700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37" returned: 0 in 0.527s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:52 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-72a467eb-6c47-42ac-b1eb-31cb60d162c3 tempest-SnapshotsActionsTest-1019030700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:30:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-72a467eb-6c47-42ac-b1eb-31cb60d162c3 tempest-SnapshotsActionsTest-1019030700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.13e299da-8ec6-4072-8f66-ddb14af93732 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:52 devstack sudo[89832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.13e299da-8ec6-4072-8f66-ddb14af93732 Nov 02 15:30:52 devstack sudo[89832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:52 devstack sudo[89832]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-72a467eb-6c47-42ac-b1eb-31cb60d162c3 tempest-SnapshotsActionsTest-1019030700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.13e299da-8ec6-4072-8f66-ddb14af93732" returned: 0 in 0.468s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-72a467eb-6c47-42ac-b1eb-31cb60d162c3 tempest-SnapshotsActionsTest-1019030700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.13e299da-8ec6-4072-8f66-ddb14af93732 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:53 devstack sudo[89839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.13e299da-8ec6-4072-8f66-ddb14af93732 Nov 02 15:30:53 devstack sudo[89839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:53 devstack sudo[89839]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-72a467eb-6c47-42ac-b1eb-31cb60d162c3 tempest-SnapshotsActionsTest-1019030700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.13e299da-8ec6-4072-8f66-ddb14af93732" returned: 0 in 0.527s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:53 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-72a467eb-6c47-42ac-b1eb-31cb60d162c3 tempest-SnapshotsActionsTest-1019030700 None] Lock "cinder-quobyte-13e299da-8ec6-4072-8f66-ddb14af93732" released by "_delete_snapshot" :: held 2.310s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:30:53 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-72a467eb-6c47-42ac-b1eb-31cb60d162c3 tempest-SnapshotsActionsTest-1019030700 None] Lock "cinder-quobyte-5963a0a4-2b1c-4904-8987-e6f69cd875f5" released by "delete_snapshot" :: held 2.351s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:30:53 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-72a467eb-6c47-42ac-b1eb-31cb60d162c3 tempest-SnapshotsActionsTest-1019030700 None] Created reservations ['eda6ad9d-2c5a-4ebb-8689-61cad71148b4', '034ee3c2-feb2-4f16-afcf-1fbb85bed689', '7bc20c9f-d78c-44d9-add1-fa90187ac7be', '929798ae-edcb-4090-9366-5b6875642430'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:30:53 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-72a467eb-6c47-42ac-b1eb-31cb60d162c3 tempest-SnapshotsActionsTest-1019030700 None] Delete snapshot completed successfully. Nov 02 15:30:53 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-72a467eb-6c47-42ac-b1eb-31cb60d162c3 tempest-SnapshotsActionsTest-1019030700 None] Lock "cinder-13e299da-8ec6-4072-8f66-ddb14af93732-delete_snapshot" released by "delete_snapshot" :: held 2.611s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:30:55 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-45b1cf56-d94c-43d3-9b61-2edd87934572 tempest-SnapshotsActionsTest-686992346 None] Acquiring lock "cinder-51c570a5-faca-4cff-9760-72252d85fc37-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:30:55 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-45b1cf56-d94c-43d3-9b61-2edd87934572 tempest-SnapshotsActionsTest-686992346 None] Lock "cinder-51c570a5-faca-4cff-9760-72252d85fc37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.065s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:30:55 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-45b1cf56-d94c-43d3-9b61-2edd87934572 tempest-SnapshotsActionsTest-686992346 None] Acquiring lock "cinder-quobyte-5963a0a4-2b1c-4904-8987-e6f69cd875f5" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:30:55 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-45b1cf56-d94c-43d3-9b61-2edd87934572 tempest-SnapshotsActionsTest-686992346 None] Lock "cinder-quobyte-5963a0a4-2b1c-4904-8987-e6f69cd875f5" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:30:55 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-45b1cf56-d94c-43d3-9b61-2edd87934572 tempest-SnapshotsActionsTest-686992346 None] Acquiring lock "cinder-quobyte-51c570a5-faca-4cff-9760-72252d85fc37" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:30:56 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-45b1cf56-d94c-43d3-9b61-2edd87934572 tempest-SnapshotsActionsTest-686992346 None] Lock "cinder-quobyte-51c570a5-faca-4cff-9760-72252d85fc37" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:30:56 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-45b1cf56-d94c-43d3-9b61-2edd87934572 tempest-SnapshotsActionsTest-686992346 None] Deleting offline snapshot 51c570a5-faca-4cff-9760-72252d85fc37 of volume 5963a0a4-2b1c-4904-8987-e6f69cd875f5 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:30:56 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-45b1cf56-d94c-43d3-9b61-2edd87934572 tempest-SnapshotsActionsTest-686992346 None] snapshot_file for this snap is: volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:30:56 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[425862d9-e084-4587-b594-67caa3a4987e]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:30:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-45b1cf56-d94c-43d3-9b61-2edd87934572 tempest-SnapshotsActionsTest-686992346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:56 devstack sudo[89888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 Nov 02 15:30:56 devstack sudo[89888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:56 devstack sudo[89888]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-45b1cf56-d94c-43d3-9b61-2edd87934572 tempest-SnapshotsActionsTest-686992346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37" returned: 0 in 0.574s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:56 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-45b1cf56-d94c-43d3-9b61-2edd87934572 tempest-SnapshotsActionsTest-686992346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:30:56 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[45079191-afda-4a6a-afe8-71141b27578a]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:30:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-45b1cf56-d94c-43d3-9b61-2edd87934572 tempest-SnapshotsActionsTest-686992346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:57 devstack sudo[89910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5 Nov 02 15:30:57 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:57 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-45b1cf56-d94c-43d3-9b61-2edd87934572 tempest-SnapshotsActionsTest-686992346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5" returned: 0 in 0.994s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-45b1cf56-d94c-43d3-9b61-2edd87934572 tempest-SnapshotsActionsTest-686992346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:57 devstack sudo[89917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 Nov 02 15:30:57 devstack sudo[89917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:58 devstack sudo[89917]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-45b1cf56-d94c-43d3-9b61-2edd87934572 tempest-SnapshotsActionsTest-686992346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37" returned: 0 in 0.822s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-45b1cf56-d94c-43d3-9b61-2edd87934572 tempest-SnapshotsActionsTest-686992346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:30:58 devstack sudo[89923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37 Nov 02 15:30:58 devstack sudo[89923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:30:58 devstack sudo[89923]: pam_unix(sudo:session): session closed for user root Nov 02 15:30:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-45b1cf56-d94c-43d3-9b61-2edd87934572 tempest-SnapshotsActionsTest-686992346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5.51c570a5-faca-4cff-9760-72252d85fc37" returned: 0 in 0.320s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:30:58 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-45b1cf56-d94c-43d3-9b61-2edd87934572 tempest-SnapshotsActionsTest-686992346 None] Lock "cinder-quobyte-51c570a5-faca-4cff-9760-72252d85fc37" released by "_delete_snapshot" :: held 2.953s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:30:58 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-45b1cf56-d94c-43d3-9b61-2edd87934572 tempest-SnapshotsActionsTest-686992346 None] Lock "cinder-quobyte-5963a0a4-2b1c-4904-8987-e6f69cd875f5" released by "delete_snapshot" :: held 2.994s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:30:59 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-45b1cf56-d94c-43d3-9b61-2edd87934572 tempest-SnapshotsActionsTest-686992346 None] Created reservations ['909162bf-3457-46c4-bc40-c03b70bd3b62', 'e257b698-82d1-4732-b6fd-fba10c0c3a8e', '4a1483ba-c0ef-4598-a197-edd27ee20534', '0714007f-b374-4a2c-ad7e-b688c84cb884'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:30:59 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-45b1cf56-d94c-43d3-9b61-2edd87934572 tempest-SnapshotsActionsTest-686992346 None] Delete snapshot completed successfully. Nov 02 15:30:59 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-45b1cf56-d94c-43d3-9b61-2edd87934572 tempest-SnapshotsActionsTest-686992346 None] Lock "cinder-51c570a5-faca-4cff-9760-72252d85fc37-delete_snapshot" released by "delete_snapshot" :: held 3.335s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:31:00 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f89963d6-f365-49d3-bdea-078733d5476e tempest-SnapshotsActionsTest-686992346 None] Acquiring lock "cinder-5963a0a4-2b1c-4904-8987-e6f69cd875f5-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:31:00 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f89963d6-f365-49d3-bdea-078733d5476e tempest-SnapshotsActionsTest-686992346 None] Lock "cinder-5963a0a4-2b1c-4904-8987-e6f69cd875f5-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:31:00 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f89963d6-f365-49d3-bdea-078733d5476e tempest-SnapshotsActionsTest-686992346 None] Acquiring lock "cinder-quobyte-5963a0a4-2b1c-4904-8987-e6f69cd875f5" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:31:00 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f89963d6-f365-49d3-bdea-078733d5476e tempest-SnapshotsActionsTest-686992346 None] Lock "cinder-quobyte-5963a0a4-2b1c-4904-8987-e6f69cd875f5" acquired by "delete_volume" :: waited 0.031s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:31:00 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b36a7df-2b58-437b-b9d9-78b7adc28e30]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:31:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f89963d6-f365-49d3-bdea-078733d5476e tempest-SnapshotsActionsTest-686992346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:00 devstack sudo[89929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5 Nov 02 15:31:00 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:01 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f89963d6-f365-49d3-bdea-078733d5476e tempest-SnapshotsActionsTest-686992346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5" returned: 0 in 0.758s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f89963d6-f365-49d3-bdea-078733d5476e tempest-SnapshotsActionsTest-686992346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:01 devstack sudo[89936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5 Nov 02 15:31:01 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:01 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f89963d6-f365-49d3-bdea-078733d5476e tempest-SnapshotsActionsTest-686992346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5963a0a4-2b1c-4904-8987-e6f69cd875f5" returned: 0 in 0.422s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:02 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f89963d6-f365-49d3-bdea-078733d5476e tempest-SnapshotsActionsTest-686992346 None] Lock "cinder-quobyte-5963a0a4-2b1c-4904-8987-e6f69cd875f5" released by "delete_volume" :: held 1.319s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:31:02 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-f89963d6-f365-49d3-bdea-078733d5476e tempest-SnapshotsActionsTest-686992346 None] Created reservations ['300c7955-dd0a-423e-ba53-b0300f6eee87', '74ae3307-f038-43c9-b821-b07b4176507c', '0d42c71c-b0ec-4eba-89ef-cd7ea3eb40af', 'd1258fc1-95b3-434c-910a-841a767e61f8'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:31:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f89963d6-f365-49d3-bdea-078733d5476e tempest-SnapshotsActionsTest-686992346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:31:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f89963d6-f365-49d3-bdea-078733d5476e tempest-SnapshotsActionsTest-686992346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:31:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f89963d6-f365-49d3-bdea-078733d5476e tempest-SnapshotsActionsTest-686992346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:31:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f89963d6-f365-49d3-bdea-078733d5476e tempest-SnapshotsActionsTest-686992346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:31:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f89963d6-f365-49d3-bdea-078733d5476e tempest-SnapshotsActionsTest-686992346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:31:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f89963d6-f365-49d3-bdea-078733d5476e tempest-SnapshotsActionsTest-686992346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:02 devstack sudo[89959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:31:02 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:03 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f89963d6-f365-49d3-bdea-078733d5476e tempest-SnapshotsActionsTest-686992346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.600s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:03 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-f89963d6-f365-49d3-bdea-078733d5476e tempest-SnapshotsActionsTest-686992346 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:31:03 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-f89963d6-f365-49d3-bdea-078733d5476e tempest-SnapshotsActionsTest-686992346 None] Deleted volume successfully. Nov 02 15:31:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f89963d6-f365-49d3-bdea-078733d5476e tempest-SnapshotsActionsTest-686992346 None] Lock "cinder-5963a0a4-2b1c-4904-8987-e6f69cd875f5-delete_volume" released by "delete_volume" :: held 2.560s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:31:12 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=47,cinder:INSERT=19,cinder:UPDATE=43,cinder:DELETE=6 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:31:13 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=51,cinder:UPDATE=57,cinder:DELETE=3,cinder:INSERT=9 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:31:20 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:31:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:31:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:31:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:31:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:31:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:31:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:20 devstack sudo[90152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:31:20 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:21 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.403s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:21 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:31:21 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager._thread_info {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:31:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread count: 8 {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 15:31:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread info: [<_MainThread(MainThread, started 125876361756800)>, , , , , , , ] {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 15:31:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-6b5295cd-26f4-4b85-9dc3-7f3ed202f838 req-42962efc-aff6-40a5-9640-6bced22f7c36 tempest-TaggedAttachmentsTest-352889208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:31:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-6b5295cd-26f4-4b85-9dc3-7f3ed202f838 req-42962efc-aff6-40a5-9640-6bced22f7c36 tempest-TaggedAttachmentsTest-352889208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:31:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-6b5295cd-26f4-4b85-9dc3-7f3ed202f838 req-42962efc-aff6-40a5-9640-6bced22f7c36 tempest-TaggedAttachmentsTest-352889208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:31:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-6b5295cd-26f4-4b85-9dc3-7f3ed202f838 req-42962efc-aff6-40a5-9640-6bced22f7c36 tempest-TaggedAttachmentsTest-352889208 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478', 'name': 'volume-b9a25bc2-10e8-401a-8132-6aface103f97', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '39fcd46c-a979-494a-80c4-c73f404bc627', 'enforce_multipath': True} {{(pid=86703) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 15:31:21 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-6b5295cd-26f4-4b85-9dc3-7f3ed202f838 req-42962efc-aff6-40a5-9640-6bced22f7c36 tempest-TaggedAttachmentsTest-352889208 None] attachment_update completed successfully. Nov 02 15:31:26 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-aef80a32-a193-4a78-92dc-71057ec85c75 req-c7058f51-6f00-4f9f-b2ae-c8f6a4c6c88f tempest-TaggedAttachmentsTest-352889208 None] Terminate volume connection completed successfully. Nov 02 15:31:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-aef80a32-a193-4a78-92dc-71057ec85c75 req-c7058f51-6f00-4f9f-b2ae-c8f6a4c6c88f tempest-TaggedAttachmentsTest-352889208 None] Deleting attachment 39fcd46c-a979-494a-80c4-c73f404bc627. {{(pid=86703) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 15:31:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-bbcac8f6-6e89-4aee-b07d-8f6308251efa req-5152bbc0-1b99-4c50-9c27-56b0475bc1f3 tempest-ServerActionsTestOtherA-1672913331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:31:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-bbcac8f6-6e89-4aee-b07d-8f6308251efa req-5152bbc0-1b99-4c50-9c27-56b0475bc1f3 tempest-ServerActionsTestOtherA-1672913331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:31:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-bbcac8f6-6e89-4aee-b07d-8f6308251efa req-5152bbc0-1b99-4c50-9c27-56b0475bc1f3 tempest-ServerActionsTestOtherA-1672913331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:31:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-bbcac8f6-6e89-4aee-b07d-8f6308251efa req-5152bbc0-1b99-4c50-9c27-56b0475bc1f3 tempest-ServerActionsTestOtherA-1672913331 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478', 'name': 'volume-f58cae23-88e1-4190-ab35-fe097b8f0861', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '46850711-5b83-4e8c-9e65-af775013d10c', 'enforce_multipath': True} {{(pid=86703) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 15:31:26 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-bbcac8f6-6e89-4aee-b07d-8f6308251efa req-5152bbc0-1b99-4c50-9c27-56b0475bc1f3 tempest-ServerActionsTestOtherA-1672913331 None] attachment_update completed successfully. Nov 02 15:31:29 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:31:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] Flow 'volume_create_manager' (e02d66e7-0612-4735-9fa1-057d62e167f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:31:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47ef193-8972-472f-9cca-a708572105cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:31:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47ef193-8972-472f-9cca-a708572105cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1578239231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1a10f8f-5901-4262-a11a-05e865c4b8c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcffe43b6d9482bbaf274801497349d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:31:29Z,use_quota=True,user_id='ad17968c25b64090ad05c485931606a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:31:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cb6ef43-5f5f-41c5-90fc-3717a2434bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:31:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cb6ef43-5f5f-41c5-90fc-3717a2434bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:31:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e535383-cad7-4056-800a-6ee3413ba91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:31:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e535383-cad7-4056-800a-6ee3413ba91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1a10f8f-5901-4262-a11a-05e865c4b8c5', 'volume_name': 'volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:31:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (830a49c5-41d5-44df-9ae6-daf28bda860a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:31:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (830a49c5-41d5-44df-9ae6-daf28bda860a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:31:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a79075fa-1f63-47af-ba0f-c5bc881f65db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:31:29 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] Volume d1a10f8f-5901-4262-a11a-05e865c4b8c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5', 'volume_size': 1} Nov 02 15:31:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:31:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:31:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1578239231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1a10f8f-5901-4262-a11a-05e865c4b8c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fcffe43b6d9482bbaf274801497349d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:31:29Z,use_quota=True,user_id='ad17968c25b64090ad05c485931606a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:31:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] Creating volume d1a10f8f-5901-4262-a11a-05e865c4b8c5 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:31:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:31:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:31:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:31:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:31:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:31:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:31:29 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:31:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:29 devstack sudo[91075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5 1073741824 Nov 02 15:31:29 devstack sudo[91075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:30 devstack sudo[91075]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5 1073741824" returned: 0 in 0.528s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:30 devstack sudo[91081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5 Nov 02 15:31:30 devstack sudo[91081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:30 devstack sudo[91081]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5" returned: 0 in 0.287s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:31:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:31:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a79075fa-1f63-47af-ba0f-c5bc881f65db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:31:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece8a2f5-8c28-4b58-a4ba-29b5e3ffb256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:31:30 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] Volume volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5 (d1a10f8f-5901-4262-a11a-05e865c4b8c5): created successfully Nov 02 15:31:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ece8a2f5-8c28-4b58-a4ba-29b5e3ffb256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:31:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] Flow 'volume_create_manager' (e02d66e7-0612-4735-9fa1-057d62e167f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:31:30 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-cf9256fa-1d29-4c4a-9cc8-9b0250bb1065 tempest-SnapshotMetadataTestJSON-1064297226 None] Created volume successfully. Nov 02 15:31:30 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-e34b856b-4d9e-4d4d-8e41-6a4d4dbe178a req-038b17f2-0783-402b-831a-fc25d6679a1f tempest-ServerActionsTestOtherA-1672913331 None] Terminate volume connection completed successfully. Nov 02 15:31:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-e34b856b-4d9e-4d4d-8e41-6a4d4dbe178a req-038b17f2-0783-402b-831a-fc25d6679a1f tempest-ServerActionsTestOtherA-1672913331 None] Deleting attachment 46850711-5b83-4e8c-9e65-af775013d10c. {{(pid=86703) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 15:31:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-e34b856b-4d9e-4d4d-8e41-6a4d4dbe178a req-8a506f87-71b0-4336-97c9-be52ab28ab13 tempest-ServerActionsTestOtherA-1672913331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:31:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-e34b856b-4d9e-4d4d-8e41-6a4d4dbe178a req-8a506f87-71b0-4336-97c9-be52ab28ab13 tempest-ServerActionsTestOtherA-1672913331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:31:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-e34b856b-4d9e-4d4d-8e41-6a4d4dbe178a req-8a506f87-71b0-4336-97c9-be52ab28ab13 tempest-ServerActionsTestOtherA-1672913331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.044s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:31:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ff6c712c-2412-4c3f-bdd8-95df43a13eda tempest-SnapshotMetadataTestJSON-1064297226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:31:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ff6c712c-2412-4c3f-bdd8-95df43a13eda tempest-SnapshotMetadataTestJSON-1064297226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:31:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-ff6c712c-2412-4c3f-bdd8-95df43a13eda tempest-SnapshotMetadataTestJSON-1064297226 None] Creating offline snapshot 02fc407a-c0f9-40a7-aaa4-2863571a279e of volume d1a10f8f-5901-4262-a11a-05e865c4b8c5 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:31:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-e34b856b-4d9e-4d4d-8e41-6a4d4dbe178a req-8a506f87-71b0-4336-97c9-be52ab28ab13 tempest-ServerActionsTestOtherA-1672913331 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478', 'name': 'volume-f58cae23-88e1-4190-ab35-fe097b8f0861', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '759e6cfd-5b44-4081-8d85-39a3f4d3939a', 'enforce_multipath': True} {{(pid=86703) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 15:31:31 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb1e71a-cf6d-403d-b528-97c1cf5af221]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:31:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ff6c712c-2412-4c3f-bdd8-95df43a13eda tempest-SnapshotMetadataTestJSON-1064297226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:32 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-e34b856b-4d9e-4d4d-8e41-6a4d4dbe178a req-8a506f87-71b0-4336-97c9-be52ab28ab13 tempest-ServerActionsTestOtherA-1672913331 None] attachment_update completed successfully. Nov 02 15:31:32 devstack sudo[91156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5 Nov 02 15:31:32 devstack sudo[91156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:32 devstack sudo[91156]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ff6c712c-2412-4c3f-bdd8-95df43a13eda tempest-SnapshotMetadataTestJSON-1064297226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5" returned: 0 in 0.617s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ff6c712c-2412-4c3f-bdd8-95df43a13eda tempest-SnapshotMetadataTestJSON-1064297226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5.02fc407a-c0f9-40a7-aaa4-2863571a279e 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:32 devstack sudo[91164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5.02fc407a-c0f9-40a7-aaa4-2863571a279e 1G Nov 02 15:31:32 devstack sudo[91164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:33 devstack sudo[91164]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ff6c712c-2412-4c3f-bdd8-95df43a13eda tempest-SnapshotMetadataTestJSON-1064297226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5.02fc407a-c0f9-40a7-aaa4-2863571a279e 1G" returned: 0 in 0.483s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ff6c712c-2412-4c3f-bdd8-95df43a13eda tempest-SnapshotMetadataTestJSON-1064297226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5.02fc407a-c0f9-40a7-aaa4-2863571a279e {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:33 devstack sudo[91183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5.02fc407a-c0f9-40a7-aaa4-2863571a279e Nov 02 15:31:33 devstack sudo[91183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:33 devstack sudo[91183]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ff6c712c-2412-4c3f-bdd8-95df43a13eda tempest-SnapshotMetadataTestJSON-1064297226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5.02fc407a-c0f9-40a7-aaa4-2863571a279e" returned: 0 in 0.324s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:33 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-ff6c712c-2412-4c3f-bdd8-95df43a13eda tempest-SnapshotMetadataTestJSON-1064297226 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5.02fc407a-c0f9-40a7-aaa4-2863571a279e is being set with open permissions: ugo+rw Nov 02 15:31:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ff6c712c-2412-4c3f-bdd8-95df43a13eda tempest-SnapshotMetadataTestJSON-1064297226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5.02fc407a-c0f9-40a7-aaa4-2863571a279e {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:33 devstack sudo[91285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5.02fc407a-c0f9-40a7-aaa4-2863571a279e Nov 02 15:31:33 devstack sudo[91285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:33 devstack sudo[91285]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ff6c712c-2412-4c3f-bdd8-95df43a13eda tempest-SnapshotMetadataTestJSON-1064297226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5.02fc407a-c0f9-40a7-aaa4-2863571a279e" returned: 0 in 0.437s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ff6c712c-2412-4c3f-bdd8-95df43a13eda tempest-SnapshotMetadataTestJSON-1064297226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:33 devstack sudo[91628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5.info Nov 02 15:31:33 devstack sudo[91628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:34 devstack sudo[91628]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ff6c712c-2412-4c3f-bdd8-95df43a13eda tempest-SnapshotMetadataTestJSON-1064297226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5.info" returned: 0 in 0.404s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:34 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-ff6c712c-2412-4c3f-bdd8-95df43a13eda tempest-SnapshotMetadataTestJSON-1064297226 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5.info is being set with open permissions: ugo+rw Nov 02 15:31:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ff6c712c-2412-4c3f-bdd8-95df43a13eda tempest-SnapshotMetadataTestJSON-1064297226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:34 devstack sudo[91647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5.info Nov 02 15:31:34 devstack sudo[91647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:34 devstack sudo[91647]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ff6c712c-2412-4c3f-bdd8-95df43a13eda tempest-SnapshotMetadataTestJSON-1064297226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5.info" returned: 0 in 0.423s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ff6c712c-2412-4c3f-bdd8-95df43a13eda tempest-SnapshotMetadataTestJSON-1064297226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.864s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:31:34 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-ff6c712c-2412-4c3f-bdd8-95df43a13eda tempest-SnapshotMetadataTestJSON-1064297226 None] Create snapshot completed successfully Nov 02 15:31:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-08bc2526-3b2e-48d9-bb5c-1f86a8cd67d1 tempest-SnapshotMetadataTestJSON-1064297226 None] Acquiring lock "cinder-02fc407a-c0f9-40a7-aaa4-2863571a279e-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:31:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-08bc2526-3b2e-48d9-bb5c-1f86a8cd67d1 tempest-SnapshotMetadataTestJSON-1064297226 None] Lock "cinder-02fc407a-c0f9-40a7-aaa4-2863571a279e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:31:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-08bc2526-3b2e-48d9-bb5c-1f86a8cd67d1 tempest-SnapshotMetadataTestJSON-1064297226 None] Acquiring lock "cinder-quobyte-d1a10f8f-5901-4262-a11a-05e865c4b8c5" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:31:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-08bc2526-3b2e-48d9-bb5c-1f86a8cd67d1 tempest-SnapshotMetadataTestJSON-1064297226 None] Lock "cinder-quobyte-d1a10f8f-5901-4262-a11a-05e865c4b8c5" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:31:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-08bc2526-3b2e-48d9-bb5c-1f86a8cd67d1 tempest-SnapshotMetadataTestJSON-1064297226 None] Acquiring lock "cinder-quobyte-02fc407a-c0f9-40a7-aaa4-2863571a279e" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:31:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-08bc2526-3b2e-48d9-bb5c-1f86a8cd67d1 tempest-SnapshotMetadataTestJSON-1064297226 None] Lock "cinder-quobyte-02fc407a-c0f9-40a7-aaa4-2863571a279e" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:31:36 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-08bc2526-3b2e-48d9-bb5c-1f86a8cd67d1 tempest-SnapshotMetadataTestJSON-1064297226 None] Deleting offline snapshot 02fc407a-c0f9-40a7-aaa4-2863571a279e of volume d1a10f8f-5901-4262-a11a-05e865c4b8c5 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:31:36 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-08bc2526-3b2e-48d9-bb5c-1f86a8cd67d1 tempest-SnapshotMetadataTestJSON-1064297226 None] snapshot_file for this snap is: volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5.02fc407a-c0f9-40a7-aaa4-2863571a279e {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:31:36 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b737edb-4775-4cbc-8d64-5165677e4313]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:31:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-08bc2526-3b2e-48d9-bb5c-1f86a8cd67d1 tempest-SnapshotMetadataTestJSON-1064297226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5.02fc407a-c0f9-40a7-aaa4-2863571a279e {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:36 devstack sudo[91654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5.02fc407a-c0f9-40a7-aaa4-2863571a279e Nov 02 15:31:36 devstack sudo[91654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:37 devstack sudo[91654]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-08bc2526-3b2e-48d9-bb5c-1f86a8cd67d1 tempest-SnapshotMetadataTestJSON-1064297226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5.02fc407a-c0f9-40a7-aaa4-2863571a279e" returned: 0 in 0.584s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-08bc2526-3b2e-48d9-bb5c-1f86a8cd67d1 tempest-SnapshotMetadataTestJSON-1064297226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:31:37 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f52ae39-af2b-420f-8f27-9af5e402864a]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:31:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-08bc2526-3b2e-48d9-bb5c-1f86a8cd67d1 tempest-SnapshotMetadataTestJSON-1064297226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:37 devstack sudo[91661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5 Nov 02 15:31:37 devstack sudo[91661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:37 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:31:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] Flow 'volume_create_manager' (45f5e56a-e814-40f5-818b-dab62b81b175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:31:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2a1b00d-d02d-4c4d-adeb-480dbebba5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:31:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2a1b00d-d02d-4c4d-adeb-480dbebba5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-339388288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb7c6aa-9096-400e-ad7b-9c6b2654833c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be90d541bcc74b2a93f4351dc0b4e597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:31:38Z,use_quota=True,user_id='56c1ef2da53c42b2a6a8b958be556799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:31:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44684325-acb7-4e9e-ba68-84b50657e559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:31:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44684325-acb7-4e9e-ba68-84b50657e559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:31:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9539049-329f-478d-ac2a-8e0b5d5da022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:31:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9539049-329f-478d-ac2a-8e0b5d5da022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eb7c6aa-9096-400e-ad7b-9c6b2654833c', 'volume_name': 'volume-1eb7c6aa-9096-400e-ad7b-9c6b2654833c', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:31:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (241c9f84-2bef-4777-88f1-589c7f6a7b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:31:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (241c9f84-2bef-4777-88f1-589c7f6a7b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:31:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60798e8e-a417-4a28-86b5-882a4838ff9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:31:37 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] Volume 1eb7c6aa-9096-400e-ad7b-9c6b2654833c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eb7c6aa-9096-400e-ad7b-9c6b2654833c', 'volume_size': 1} Nov 02 15:31:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:31:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:31:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-339388288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eb7c6aa-9096-400e-ad7b-9c6b2654833c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be90d541bcc74b2a93f4351dc0b4e597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:31:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:31:38Z,use_quota=True,user_id='56c1ef2da53c42b2a6a8b958be556799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:31:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] Creating volume 1eb7c6aa-9096-400e-ad7b-9c6b2654833c {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:31:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:31:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:31:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:31:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:31:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:31:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:31:37 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:31:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1eb7c6aa-9096-400e-ad7b-9c6b2654833c 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:37 devstack sudo[91666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1eb7c6aa-9096-400e-ad7b-9c6b2654833c 1073741824 Nov 02 15:31:37 devstack sudo[91666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:37 devstack sudo[91661]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-08bc2526-3b2e-48d9-bb5c-1f86a8cd67d1 tempest-SnapshotMetadataTestJSON-1064297226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5" returned: 0 in 0.744s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-08bc2526-3b2e-48d9-bb5c-1f86a8cd67d1 tempest-SnapshotMetadataTestJSON-1064297226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5.02fc407a-c0f9-40a7-aaa4-2863571a279e {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:38 devstack sudo[91668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5.02fc407a-c0f9-40a7-aaa4-2863571a279e Nov 02 15:31:38 devstack sudo[91668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:38 devstack sudo[91668]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-08bc2526-3b2e-48d9-bb5c-1f86a8cd67d1 tempest-SnapshotMetadataTestJSON-1064297226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5.02fc407a-c0f9-40a7-aaa4-2863571a279e" returned: 0 in 0.627s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-08bc2526-3b2e-48d9-bb5c-1f86a8cd67d1 tempest-SnapshotMetadataTestJSON-1064297226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5.02fc407a-c0f9-40a7-aaa4-2863571a279e {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:38 devstack sudo[91680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5.02fc407a-c0f9-40a7-aaa4-2863571a279e Nov 02 15:31:38 devstack sudo[91680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:38 devstack sudo[91666]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1eb7c6aa-9096-400e-ad7b-9c6b2654833c 1073741824" returned: 0 in 0.787s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1eb7c6aa-9096-400e-ad7b-9c6b2654833c {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:38 devstack sudo[91682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1eb7c6aa-9096-400e-ad7b-9c6b2654833c Nov 02 15:31:38 devstack sudo[91682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:38 devstack sudo[91680]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-08bc2526-3b2e-48d9-bb5c-1f86a8cd67d1 tempest-SnapshotMetadataTestJSON-1064297226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5.02fc407a-c0f9-40a7-aaa4-2863571a279e" returned: 0 in 0.361s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7fb10755-3770-4a30-8747-f5c79e6832da tempest-TaggedAttachmentsTest-352889208 None] Acquiring lock "cinder-b9a25bc2-10e8-401a-8132-6aface103f97-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:31:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-08bc2526-3b2e-48d9-bb5c-1f86a8cd67d1 tempest-SnapshotMetadataTestJSON-1064297226 None] Lock "cinder-quobyte-02fc407a-c0f9-40a7-aaa4-2863571a279e" released by "_delete_snapshot" :: held 2.525s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:31:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-08bc2526-3b2e-48d9-bb5c-1f86a8cd67d1 tempest-SnapshotMetadataTestJSON-1064297226 None] Lock "cinder-quobyte-d1a10f8f-5901-4262-a11a-05e865c4b8c5" released by "delete_snapshot" :: held 2.583s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:31:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7fb10755-3770-4a30-8747-f5c79e6832da tempest-TaggedAttachmentsTest-352889208 None] Lock "cinder-b9a25bc2-10e8-401a-8132-6aface103f97-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:31:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7fb10755-3770-4a30-8747-f5c79e6832da tempest-TaggedAttachmentsTest-352889208 None] Acquiring lock "cinder-quobyte-b9a25bc2-10e8-401a-8132-6aface103f97" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:31:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7fb10755-3770-4a30-8747-f5c79e6832da tempest-TaggedAttachmentsTest-352889208 None] Lock "cinder-quobyte-b9a25bc2-10e8-401a-8132-6aface103f97" acquired by "delete_volume" :: waited 0.022s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:31:39 devstack sudo[91682]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1eb7c6aa-9096-400e-ad7b-9c6b2654833c" returned: 0 in 0.353s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:39 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:31:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:31:39 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60798e8e-a417-4a28-86b5-882a4838ff9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eb7c6aa-9096-400e-ad7b-9c6b2654833c', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:31:39 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (225ecad4-d1b4-4ac2-8ad5-dfeb0506e542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:31:39 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fe7861-62da-4762-aab6-368f96dde7e7]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:31:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7fb10755-3770-4a30-8747-f5c79e6832da tempest-TaggedAttachmentsTest-352889208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b9a25bc2-10e8-401a-8132-6aface103f97 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:39 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] Volume volume-1eb7c6aa-9096-400e-ad7b-9c6b2654833c (1eb7c6aa-9096-400e-ad7b-9c6b2654833c): created successfully Nov 02 15:31:39 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (225ecad4-d1b4-4ac2-8ad5-dfeb0506e542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:31:39 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] Flow 'volume_create_manager' (45f5e56a-e814-40f5-818b-dab62b81b175) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:31:39 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-9dfda408-c5f1-44a3-b88d-d21e14452604 tempest-AttachVolumeTestJSON-1784642411 None] Created volume successfully. Nov 02 15:31:39 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-08bc2526-3b2e-48d9-bb5c-1f86a8cd67d1 tempest-SnapshotMetadataTestJSON-1064297226 None] Created reservations ['9772da8a-a351-4642-88ec-f563a0c082b7', '6d429ce8-ee62-462d-b6d4-c0ff32f85d1f', '07f81c5c-2ee7-454b-92d2-3948b94f8312', 'bb7fec05-3ce6-4ac6-be25-83a0205def3f'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:31:39 devstack sudo[91686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b9a25bc2-10e8-401a-8132-6aface103f97 Nov 02 15:31:39 devstack sudo[91686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:39 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-08bc2526-3b2e-48d9-bb5c-1f86a8cd67d1 tempest-SnapshotMetadataTestJSON-1064297226 None] Delete snapshot completed successfully. Nov 02 15:31:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-08bc2526-3b2e-48d9-bb5c-1f86a8cd67d1 tempest-SnapshotMetadataTestJSON-1064297226 None] Lock "cinder-02fc407a-c0f9-40a7-aaa4-2863571a279e-delete_snapshot" released by "delete_snapshot" :: held 2.890s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:31:39 devstack sudo[91686]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7fb10755-3770-4a30-8747-f5c79e6832da tempest-TaggedAttachmentsTest-352889208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b9a25bc2-10e8-401a-8132-6aface103f97" returned: 0 in 0.373s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7fb10755-3770-4a30-8747-f5c79e6832da tempest-TaggedAttachmentsTest-352889208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b9a25bc2-10e8-401a-8132-6aface103f97 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:39 devstack sudo[91691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b9a25bc2-10e8-401a-8132-6aface103f97 Nov 02 15:31:39 devstack sudo[91691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a3f7955e-f801-4465-9f54-31298bede338 tempest-SnapshotMetadataTestJSON-1064297226 None] Acquiring lock "cinder-d1a10f8f-5901-4262-a11a-05e865c4b8c5-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:31:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a3f7955e-f801-4465-9f54-31298bede338 tempest-SnapshotMetadataTestJSON-1064297226 None] Lock "cinder-d1a10f8f-5901-4262-a11a-05e865c4b8c5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:31:39 devstack sudo[91691]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7fb10755-3770-4a30-8747-f5c79e6832da tempest-TaggedAttachmentsTest-352889208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b9a25bc2-10e8-401a-8132-6aface103f97" returned: 0 in 0.289s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7fb10755-3770-4a30-8747-f5c79e6832da tempest-TaggedAttachmentsTest-352889208 None] Lock "cinder-quobyte-b9a25bc2-10e8-401a-8132-6aface103f97" released by "delete_volume" :: held 0.737s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:31:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a3f7955e-f801-4465-9f54-31298bede338 tempest-SnapshotMetadataTestJSON-1064297226 None] Acquiring lock "cinder-quobyte-d1a10f8f-5901-4262-a11a-05e865c4b8c5" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:31:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a3f7955e-f801-4465-9f54-31298bede338 tempest-SnapshotMetadataTestJSON-1064297226 None] Lock "cinder-quobyte-d1a10f8f-5901-4262-a11a-05e865c4b8c5" acquired by "delete_volume" :: waited 0.022s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:31:39 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96e1c9d-3cc2-442a-9b0c-4fb9499d305c]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:31:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a3f7955e-f801-4465-9f54-31298bede338 tempest-SnapshotMetadataTestJSON-1064297226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:39 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-7fb10755-3770-4a30-8747-f5c79e6832da tempest-TaggedAttachmentsTest-352889208 None] Created reservations ['61dbcd85-bdcb-46c0-b2a0-60a90c19c33d', 'cebe9bc0-5577-4db1-a7e3-8acb4f96d481', '557f893c-ffdd-4888-b52d-3354e8cc820c', '1e2f70ae-d256-4e64-bd13-78f7dd292709'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:31:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7fb10755-3770-4a30-8747-f5c79e6832da tempest-TaggedAttachmentsTest-352889208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:31:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7fb10755-3770-4a30-8747-f5c79e6832da tempest-TaggedAttachmentsTest-352889208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:31:40 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7fb10755-3770-4a30-8747-f5c79e6832da tempest-TaggedAttachmentsTest-352889208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:31:40 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7fb10755-3770-4a30-8747-f5c79e6832da tempest-TaggedAttachmentsTest-352889208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:31:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7fb10755-3770-4a30-8747-f5c79e6832da tempest-TaggedAttachmentsTest-352889208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:31:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7fb10755-3770-4a30-8747-f5c79e6832da tempest-TaggedAttachmentsTest-352889208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:40 devstack sudo[91695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:31:40 devstack sudo[91695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:40 devstack sudo[91694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5 Nov 02 15:31:40 devstack sudo[91694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:40 devstack sudo[91695]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7fb10755-3770-4a30-8747-f5c79e6832da tempest-TaggedAttachmentsTest-352889208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.440s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:40 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-7fb10755-3770-4a30-8747-f5c79e6832da tempest-TaggedAttachmentsTest-352889208 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:31:40 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-7fb10755-3770-4a30-8747-f5c79e6832da tempest-TaggedAttachmentsTest-352889208 None] Deleted volume successfully. Nov 02 15:31:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7fb10755-3770-4a30-8747-f5c79e6832da tempest-TaggedAttachmentsTest-352889208 None] Lock "cinder-b9a25bc2-10e8-401a-8132-6aface103f97-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:31:40 devstack sudo[91694]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a3f7955e-f801-4465-9f54-31298bede338 tempest-SnapshotMetadataTestJSON-1064297226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5" returned: 0 in 0.641s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a3f7955e-f801-4465-9f54-31298bede338 tempest-SnapshotMetadataTestJSON-1064297226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:40 devstack sudo[91708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5 Nov 02 15:31:40 devstack sudo[91708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-d04c8fe7-74fe-4bc5-9811-69b3d5a37973 req-e39be3d8-ebe8-4f62-9583-7763bbcd1311 tempest-AttachVolumeTestJSON-1784642411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:31:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-d04c8fe7-74fe-4bc5-9811-69b3d5a37973 req-e39be3d8-ebe8-4f62-9583-7763bbcd1311 tempest-AttachVolumeTestJSON-1784642411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:31:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-d04c8fe7-74fe-4bc5-9811-69b3d5a37973 req-e39be3d8-ebe8-4f62-9583-7763bbcd1311 tempest-AttachVolumeTestJSON-1784642411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:31:40 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-d04c8fe7-74fe-4bc5-9811-69b3d5a37973 req-e39be3d8-ebe8-4f62-9583-7763bbcd1311 tempest-AttachVolumeTestJSON-1784642411 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478', 'name': 'volume-1eb7c6aa-9096-400e-ad7b-9c6b2654833c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4acdfa63-90d8-4e61-95d8-ff548f0a6940', 'enforce_multipath': True} {{(pid=86703) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 15:31:40 devstack sudo[91708]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a3f7955e-f801-4465-9f54-31298bede338 tempest-SnapshotMetadataTestJSON-1064297226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d1a10f8f-5901-4262-a11a-05e865c4b8c5" returned: 0 in 0.350s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a3f7955e-f801-4465-9f54-31298bede338 tempest-SnapshotMetadataTestJSON-1064297226 None] Lock "cinder-quobyte-d1a10f8f-5901-4262-a11a-05e865c4b8c5" released by "delete_volume" :: held 1.075s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:31:41 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-d04c8fe7-74fe-4bc5-9811-69b3d5a37973 req-e39be3d8-ebe8-4f62-9583-7763bbcd1311 tempest-AttachVolumeTestJSON-1784642411 None] attachment_update completed successfully. Nov 02 15:31:41 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-a3f7955e-f801-4465-9f54-31298bede338 tempest-SnapshotMetadataTestJSON-1064297226 None] Created reservations ['03240080-966d-43b2-9b01-b99d74e0577a', '5b020c62-6136-4973-b489-5da70b52641d', 'a0bf9291-03c4-48ba-93ef-77d0fbcb8124', '38966ee4-17e3-4f68-87bc-b528a0a2583b'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:31:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a3f7955e-f801-4465-9f54-31298bede338 tempest-SnapshotMetadataTestJSON-1064297226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:31:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a3f7955e-f801-4465-9f54-31298bede338 tempest-SnapshotMetadataTestJSON-1064297226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:31:41 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-a3f7955e-f801-4465-9f54-31298bede338 tempest-SnapshotMetadataTestJSON-1064297226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:31:41 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-a3f7955e-f801-4465-9f54-31298bede338 tempest-SnapshotMetadataTestJSON-1064297226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:31:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a3f7955e-f801-4465-9f54-31298bede338 tempest-SnapshotMetadataTestJSON-1064297226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:31:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a3f7955e-f801-4465-9f54-31298bede338 tempest-SnapshotMetadataTestJSON-1064297226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:41 devstack sudo[91713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:31:41 devstack sudo[91713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:41 devstack sudo[91713]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a3f7955e-f801-4465-9f54-31298bede338 tempest-SnapshotMetadataTestJSON-1064297226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.396s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:41 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-a3f7955e-f801-4465-9f54-31298bede338 tempest-SnapshotMetadataTestJSON-1064297226 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:31:41 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-a3f7955e-f801-4465-9f54-31298bede338 tempest-SnapshotMetadataTestJSON-1064297226 None] Deleted volume successfully. Nov 02 15:31:41 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a3f7955e-f801-4465-9f54-31298bede338 tempest-SnapshotMetadataTestJSON-1064297226 None] Lock "cinder-d1a10f8f-5901-4262-a11a-05e865c4b8c5-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:31:43 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:31:43 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] Flow 'volume_create_manager' (a6c02e2e-8538-4b12-b2cd-2bca0c9f9c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:31:43 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed1cc98-1d21-4072-9fdb-86f0b479bf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:31:43 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bed1cc98-1d21-4072-9fdb-86f0b479bf67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1726161070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a30f75b4-5599-4e7e-934e-f7860c23f0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be90d541bcc74b2a93f4351dc0b4e597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:31:44Z,use_quota=True,user_id='56c1ef2da53c42b2a6a8b958be556799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:31:43 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b93b548-ed19-4cdd-83e1-58bd4f3617a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:31:43 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b93b548-ed19-4cdd-83e1-58bd4f3617a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:31:43 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c9df00-a585-474b-bf33-73919bfd7041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:31:43 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c9df00-a585-474b-bf33-73919bfd7041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a30f75b4-5599-4e7e-934e-f7860c23f0c0', 'volume_name': 'volume-a30f75b4-5599-4e7e-934e-f7860c23f0c0', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:31:43 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eb0a9f5-d856-422a-89cb-99c827405106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:31:43 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eb0a9f5-d856-422a-89cb-99c827405106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:31:43 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17c9c990-b465-4b5f-85d7-9c3069412dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:31:43 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] Volume a30f75b4-5599-4e7e-934e-f7860c23f0c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a30f75b4-5599-4e7e-934e-f7860c23f0c0', 'volume_size': 1} Nov 02 15:31:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:31:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:31:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1726161070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a30f75b4-5599-4e7e-934e-f7860c23f0c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be90d541bcc74b2a93f4351dc0b4e597',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:31:44Z,use_quota=True,user_id='56c1ef2da53c42b2a6a8b958be556799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:31:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] Creating volume a30f75b4-5599-4e7e-934e-f7860c23f0c0 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:31:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:31:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:31:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:31:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:31:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:31:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:31:43 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:31:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a30f75b4-5599-4e7e-934e-f7860c23f0c0 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:44 devstack sudo[91735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a30f75b4-5599-4e7e-934e-f7860c23f0c0 1073741824 Nov 02 15:31:44 devstack sudo[91735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:44 devstack sudo[91735]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a30f75b4-5599-4e7e-934e-f7860c23f0c0 1073741824" returned: 0 in 0.571s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a30f75b4-5599-4e7e-934e-f7860c23f0c0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:44 devstack sudo[91741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a30f75b4-5599-4e7e-934e-f7860c23f0c0 Nov 02 15:31:44 devstack sudo[91741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:45 devstack sudo[91741]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a30f75b4-5599-4e7e-934e-f7860c23f0c0" returned: 0 in 0.501s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:45 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:31:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:31:45 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17c9c990-b465-4b5f-85d7-9c3069412dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a30f75b4-5599-4e7e-934e-f7860c23f0c0', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:31:45 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51dc58b6-2301-4e40-8e73-0378e13dffa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:31:45 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] Volume volume-a30f75b4-5599-4e7e-934e-f7860c23f0c0 (a30f75b4-5599-4e7e-934e-f7860c23f0c0): created successfully Nov 02 15:31:45 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51dc58b6-2301-4e40-8e73-0378e13dffa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:31:45 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] Flow 'volume_create_manager' (a6c02e2e-8538-4b12-b2cd-2bca0c9f9c56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:31:45 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-9d82622b-d360-43d8-a2ac-ff3ab6b86caa tempest-AttachVolumeTestJSON-1784642411 None] Created volume successfully. Nov 02 15:31:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-38cc7ec0-e158-49f9-b2b4-297f049ec72e req-c240ba78-4542-4ee9-8768-20f25140f3d8 tempest-AttachVolumeTestJSON-1784642411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:31:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-38cc7ec0-e158-49f9-b2b4-297f049ec72e req-c240ba78-4542-4ee9-8768-20f25140f3d8 tempest-AttachVolumeTestJSON-1784642411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:31:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-38cc7ec0-e158-49f9-b2b4-297f049ec72e req-c240ba78-4542-4ee9-8768-20f25140f3d8 tempest-AttachVolumeTestJSON-1784642411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:31:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-38cc7ec0-e158-49f9-b2b4-297f049ec72e req-c240ba78-4542-4ee9-8768-20f25140f3d8 tempest-AttachVolumeTestJSON-1784642411 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478', 'name': 'volume-a30f75b4-5599-4e7e-934e-f7860c23f0c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a62d48be-d0bf-4400-a65e-df9303307b2a', 'enforce_multipath': True} {{(pid=86703) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 15:31:47 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-38cc7ec0-e158-49f9-b2b4-297f049ec72e req-c240ba78-4542-4ee9-8768-20f25140f3d8 tempest-AttachVolumeTestJSON-1784642411 None] attachment_update completed successfully. Nov 02 15:31:48 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:31:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] Flow 'volume_create_manager' (b3c39808-1c87-4fd9-9b70-33460cb8e7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:31:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e96a91-ef7c-4170-8892-2682b9c16694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:31:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30e96a91-ef7c-4170-8892-2682b9c16694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-432615480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2f6a17a-353f-41b8-8d38-e7cda1cd6ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36b09a421295465c85c039da1159b33e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:31:49Z,use_quota=True,user_id='4cc94097cb9f43629b755ef4143b1fad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:31:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e5f246f-8104-4d16-96c2-d8e1f71c2107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:31:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e5f246f-8104-4d16-96c2-d8e1f71c2107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:31:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889d0e1a-2d6c-4ec1-806b-55571b2ca9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:31:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (889d0e1a-2d6c-4ec1-806b-55571b2ca9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2f6a17a-353f-41b8-8d38-e7cda1cd6ec0', 'volume_name': 'volume-e2f6a17a-353f-41b8-8d38-e7cda1cd6ec0', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:31:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a061dc9e-048d-4bfe-a338-682a49300a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:31:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a061dc9e-048d-4bfe-a338-682a49300a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:31:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c190116-17a2-4a38-ac4e-3040c9c635ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:31:48 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] Volume e2f6a17a-353f-41b8-8d38-e7cda1cd6ec0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2f6a17a-353f-41b8-8d38-e7cda1cd6ec0', 'volume_size': 1} Nov 02 15:31:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:31:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:31:48 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-432615480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2f6a17a-353f-41b8-8d38-e7cda1cd6ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36b09a421295465c85c039da1159b33e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:31:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:31:49Z,use_quota=True,user_id='4cc94097cb9f43629b755ef4143b1fad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:31:48 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] Creating volume e2f6a17a-353f-41b8-8d38-e7cda1cd6ec0 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:31:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:31:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:31:48 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:31:48 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:31:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:31:48 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:31:48 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:31:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2f6a17a-353f-41b8-8d38-e7cda1cd6ec0 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:48 devstack sudo[91815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2f6a17a-353f-41b8-8d38-e7cda1cd6ec0 1073741824 Nov 02 15:31:48 devstack sudo[91815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:49 devstack sudo[91815]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2f6a17a-353f-41b8-8d38-e7cda1cd6ec0 1073741824" returned: 0 in 0.558s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2f6a17a-353f-41b8-8d38-e7cda1cd6ec0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:49 devstack sudo[91824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2f6a17a-353f-41b8-8d38-e7cda1cd6ec0 Nov 02 15:31:49 devstack sudo[91824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:49 devstack sudo[91824]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2f6a17a-353f-41b8-8d38-e7cda1cd6ec0" returned: 0 in 0.352s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:31:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:31:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c190116-17a2-4a38-ac4e-3040c9c635ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2f6a17a-353f-41b8-8d38-e7cda1cd6ec0', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:31:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b380e330-ae05-4999-851c-8e7a8633948c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:31:49 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] Volume volume-e2f6a17a-353f-41b8-8d38-e7cda1cd6ec0 (e2f6a17a-353f-41b8-8d38-e7cda1cd6ec0): created successfully Nov 02 15:31:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b380e330-ae05-4999-851c-8e7a8633948c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:31:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] Flow 'volume_create_manager' (b3c39808-1c87-4fd9-9b70-33460cb8e7af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:31:49 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-b40f5925-1ca5-4974-b544-735ca1e9f882 tempest-AbsoluteLimitsTests-306472288 None] Created volume successfully. Nov 02 15:31:50 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-c0965632-392c-4b78-9a02-362ba234c54b req-7590013b-7e1e-4e56-ab4f-ab0282e76fef tempest-AttachVolumeTestJSON-1784642411 None] Terminate volume connection completed successfully. Nov 02 15:31:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-c0965632-392c-4b78-9a02-362ba234c54b req-7590013b-7e1e-4e56-ab4f-ab0282e76fef tempest-AttachVolumeTestJSON-1784642411 None] Deleting attachment 4acdfa63-90d8-4e61-95d8-ff548f0a6940. {{(pid=86703) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 15:31:51 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-190f58eb-46c9-4f2e-b2cf-7369991bc3b3 tempest-AbsoluteLimitsTests-306472288 None] Acquiring lock "cinder-e2f6a17a-353f-41b8-8d38-e7cda1cd6ec0-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:31:51 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-190f58eb-46c9-4f2e-b2cf-7369991bc3b3 tempest-AbsoluteLimitsTests-306472288 None] Lock "cinder-e2f6a17a-353f-41b8-8d38-e7cda1cd6ec0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:31:51 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-190f58eb-46c9-4f2e-b2cf-7369991bc3b3 tempest-AbsoluteLimitsTests-306472288 None] Acquiring lock "cinder-quobyte-e2f6a17a-353f-41b8-8d38-e7cda1cd6ec0" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:31:51 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-190f58eb-46c9-4f2e-b2cf-7369991bc3b3 tempest-AbsoluteLimitsTests-306472288 None] Lock "cinder-quobyte-e2f6a17a-353f-41b8-8d38-e7cda1cd6ec0" acquired by "delete_volume" :: waited 0.021s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:31:51 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1205a5c-e581-44a8-886e-432365a7b08e]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:31:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-190f58eb-46c9-4f2e-b2cf-7369991bc3b3 tempest-AbsoluteLimitsTests-306472288 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2f6a17a-353f-41b8-8d38-e7cda1cd6ec0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:51 devstack sudo[91830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2f6a17a-353f-41b8-8d38-e7cda1cd6ec0 Nov 02 15:31:51 devstack sudo[91830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:51 devstack sudo[91830]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-190f58eb-46c9-4f2e-b2cf-7369991bc3b3 tempest-AbsoluteLimitsTests-306472288 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2f6a17a-353f-41b8-8d38-e7cda1cd6ec0" returned: 0 in 0.462s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-190f58eb-46c9-4f2e-b2cf-7369991bc3b3 tempest-AbsoluteLimitsTests-306472288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2f6a17a-353f-41b8-8d38-e7cda1cd6ec0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:51 devstack sudo[91836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2f6a17a-353f-41b8-8d38-e7cda1cd6ec0 Nov 02 15:31:51 devstack sudo[91836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:51 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-70f54eb7-ff8b-4aae-a48a-647843b8bde5 req-f7ebd777-663c-4f22-b9e7-909368b1f747 tempest-AttachVolumeTestJSON-1784642411 None] Terminate volume connection completed successfully. Nov 02 15:31:51 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-70f54eb7-ff8b-4aae-a48a-647843b8bde5 req-f7ebd777-663c-4f22-b9e7-909368b1f747 tempest-AttachVolumeTestJSON-1784642411 None] Deleting attachment a62d48be-d0bf-4400-a65e-df9303307b2a. {{(pid=86703) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 15:31:52 devstack sudo[91836]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-190f58eb-46c9-4f2e-b2cf-7369991bc3b3 tempest-AbsoluteLimitsTests-306472288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2f6a17a-353f-41b8-8d38-e7cda1cd6ec0" returned: 0 in 0.287s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:52 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-190f58eb-46c9-4f2e-b2cf-7369991bc3b3 tempest-AbsoluteLimitsTests-306472288 None] Lock "cinder-quobyte-e2f6a17a-353f-41b8-8d38-e7cda1cd6ec0" released by "delete_volume" :: held 0.794s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:31:52 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-190f58eb-46c9-4f2e-b2cf-7369991bc3b3 tempest-AbsoluteLimitsTests-306472288 None] Created reservations ['95873cf9-c4de-406d-b95f-4281ce3b868c', 'd039bc58-139e-474e-a8e1-501a6b0d8676', '13761a46-f20f-4107-9ca3-4d5270b2979c', '8f33012f-0da3-4a70-8113-dd0fc5c2d64a'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:31:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-190f58eb-46c9-4f2e-b2cf-7369991bc3b3 tempest-AbsoluteLimitsTests-306472288 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:31:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-190f58eb-46c9-4f2e-b2cf-7369991bc3b3 tempest-AbsoluteLimitsTests-306472288 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:31:52 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-190f58eb-46c9-4f2e-b2cf-7369991bc3b3 tempest-AbsoluteLimitsTests-306472288 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:31:52 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-190f58eb-46c9-4f2e-b2cf-7369991bc3b3 tempest-AbsoluteLimitsTests-306472288 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:31:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-190f58eb-46c9-4f2e-b2cf-7369991bc3b3 tempest-AbsoluteLimitsTests-306472288 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:31:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-190f58eb-46c9-4f2e-b2cf-7369991bc3b3 tempest-AbsoluteLimitsTests-306472288 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:52 devstack sudo[91841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:31:52 devstack sudo[91841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:52 devstack sudo[91841]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-190f58eb-46c9-4f2e-b2cf-7369991bc3b3 tempest-AbsoluteLimitsTests-306472288 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.277s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:52 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-190f58eb-46c9-4f2e-b2cf-7369991bc3b3 tempest-AbsoluteLimitsTests-306472288 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:31:52 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-190f58eb-46c9-4f2e-b2cf-7369991bc3b3 tempest-AbsoluteLimitsTests-306472288 None] Deleted volume successfully. Nov 02 15:31:52 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-190f58eb-46c9-4f2e-b2cf-7369991bc3b3 tempest-AbsoluteLimitsTests-306472288 None] Lock "cinder-e2f6a17a-353f-41b8-8d38-e7cda1cd6ec0-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:31:58 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-cff6c3a4-f456-41cb-8917-6f9f18c985fb tempest-AttachVolumeTestJSON-1784642411 None] Acquiring lock "cinder-a30f75b4-5599-4e7e-934e-f7860c23f0c0-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:31:58 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-cff6c3a4-f456-41cb-8917-6f9f18c985fb tempest-AttachVolumeTestJSON-1784642411 None] Lock "cinder-a30f75b4-5599-4e7e-934e-f7860c23f0c0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:31:58 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-cff6c3a4-f456-41cb-8917-6f9f18c985fb tempest-AttachVolumeTestJSON-1784642411 None] Acquiring lock "cinder-quobyte-a30f75b4-5599-4e7e-934e-f7860c23f0c0" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:31:58 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-cff6c3a4-f456-41cb-8917-6f9f18c985fb tempest-AttachVolumeTestJSON-1784642411 None] Lock "cinder-quobyte-a30f75b4-5599-4e7e-934e-f7860c23f0c0" acquired by "delete_volume" :: waited 0.022s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:31:58 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b88ae1-9566-4962-96df-5b7499c50451]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:31:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cff6c3a4-f456-41cb-8917-6f9f18c985fb tempest-AttachVolumeTestJSON-1784642411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a30f75b4-5599-4e7e-934e-f7860c23f0c0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:58 devstack sudo[91891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a30f75b4-5599-4e7e-934e-f7860c23f0c0 Nov 02 15:31:58 devstack sudo[91891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:58 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] Flow 'volume_create_manager' (1a5f05d6-8f27-40ed-8933-2f63377a0e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be124a6-3a0e-414c-9164-c39d43ae6dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be124a6-3a0e-414c-9164-c39d43ae6dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1764584332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2e5d9ef-45a2-4974-b9b7-8e6685bc1348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fec202c2de54ba790f44c99e0a28493',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:31:59Z,use_quota=True,user_id='8350f6dc69a24e90aceda39ce7809e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ba687e0-b5da-4750-8608-fc816d3511c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ba687e0-b5da-4750-8608-fc816d3511c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75de9efb-b5c4-4f08-bdd2-963f54f11b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75de9efb-b5c4-4f08-bdd2-963f54f11b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2e5d9ef-45a2-4974-b9b7-8e6685bc1348', 'volume_name': 'volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b67fc7-0c96-4b8f-8837-b65bc55e3623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51b67fc7-0c96-4b8f-8837-b65bc55e3623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec71dd5-a667-4a19-a20a-58466beb31e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:31:59 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] Volume e2e5d9ef-45a2-4974-b9b7-8e6685bc1348: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348', 'volume_size': 1} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1764584332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2e5d9ef-45a2-4974-b9b7-8e6685bc1348,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fec202c2de54ba790f44c99e0a28493',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:31:59Z,use_quota=True,user_id='8350f6dc69a24e90aceda39ce7809e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] Creating volume e2e5d9ef-45a2-4974-b9b7-8e6685bc1348 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:31:59 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:59 devstack sudo[91893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348 1073741824 Nov 02 15:31:59 devstack sudo[91893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:59 devstack sudo[91891]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cff6c3a4-f456-41cb-8917-6f9f18c985fb tempest-AttachVolumeTestJSON-1784642411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a30f75b4-5599-4e7e-934e-f7860c23f0c0" returned: 0 in 0.635s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cff6c3a4-f456-41cb-8917-6f9f18c985fb tempest-AttachVolumeTestJSON-1784642411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a30f75b4-5599-4e7e-934e-f7860c23f0c0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:59 devstack sudo[91901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a30f75b4-5599-4e7e-934e-f7860c23f0c0 Nov 02 15:31:59 devstack sudo[91901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:59 devstack sudo[91893]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348 1073741824" returned: 0 in 0.563s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:59 devstack sudo[91905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348 Nov 02 15:31:59 devstack sudo[91905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:59 devstack sudo[91901]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cff6c3a4-f456-41cb-8917-6f9f18c985fb tempest-AttachVolumeTestJSON-1784642411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a30f75b4-5599-4e7e-934e-f7860c23f0c0" returned: 0 in 0.280s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-cff6c3a4-f456-41cb-8917-6f9f18c985fb tempest-AttachVolumeTestJSON-1784642411 None] Lock "cinder-quobyte-a30f75b4-5599-4e7e-934e-f7860c23f0c0" released by "delete_volume" :: held 0.987s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-cff6c3a4-f456-41cb-8917-6f9f18c985fb tempest-AttachVolumeTestJSON-1784642411 None] Created reservations ['a28ab8ee-9232-44b2-a5e6-f12831d07556', '0f9ea24b-c92f-496b-a785-5c0e71329dcb', '9724abbb-54f0-42b2-91a5-57ea9839abf9', 'b4a10e4e-5a7d-4826-8e7b-f9447dac2d52'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-cff6c3a4-f456-41cb-8917-6f9f18c985fb tempest-AttachVolumeTestJSON-1784642411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-cff6c3a4-f456-41cb-8917-6f9f18c985fb tempest-AttachVolumeTestJSON-1784642411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-cff6c3a4-f456-41cb-8917-6f9f18c985fb tempest-AttachVolumeTestJSON-1784642411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-cff6c3a4-f456-41cb-8917-6f9f18c985fb tempest-AttachVolumeTestJSON-1784642411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-cff6c3a4-f456-41cb-8917-6f9f18c985fb tempest-AttachVolumeTestJSON-1784642411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cff6c3a4-f456-41cb-8917-6f9f18c985fb tempest-AttachVolumeTestJSON-1784642411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:31:59 devstack sudo[91907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:31:59 devstack sudo[91907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:31:59 devstack sudo[91905]: pam_unix(sudo:session): session closed for user root Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348" returned: 0 in 0.279s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] <== create_volume: return (887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec71dd5-a667-4a19-a20a-58466beb31e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:31:59 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ed3c407-7a41-4690-9888-b3fc10cd5761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:00 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] Volume volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348 (e2e5d9ef-45a2-4974-b9b7-8e6685bc1348): created successfully Nov 02 15:32:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ed3c407-7a41-4690-9888-b3fc10cd5761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] Flow 'volume_create_manager' (1a5f05d6-8f27-40ed-8933-2f63377a0e89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:32:00 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-c72ee007-f188-46b5-a4e3-c33df71c0120 tempest-VolumesDeleteCascade-1219762349 None] Created volume successfully. Nov 02 15:32:00 devstack sudo[91907]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cff6c3a4-f456-41cb-8917-6f9f18c985fb tempest-AttachVolumeTestJSON-1784642411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.299s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:00 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-cff6c3a4-f456-41cb-8917-6f9f18c985fb tempest-AttachVolumeTestJSON-1784642411 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:32:00 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-cff6c3a4-f456-41cb-8917-6f9f18c985fb tempest-AttachVolumeTestJSON-1784642411 None] Deleted volume successfully. Nov 02 15:32:00 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-cff6c3a4-f456-41cb-8917-6f9f18c985fb tempest-AttachVolumeTestJSON-1784642411 None] Lock "cinder-a30f75b4-5599-4e7e-934e-f7860c23f0c0-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:32:00 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-1191b0f5-0e9b-48b9-9433-d97c4e89f640 tempest-AttachVolumeTestJSON-1784642411 None] Acquiring lock "cinder-1eb7c6aa-9096-400e-ad7b-9c6b2654833c-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:32:00 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-1191b0f5-0e9b-48b9-9433-d97c4e89f640 tempest-AttachVolumeTestJSON-1784642411 None] Lock "cinder-1eb7c6aa-9096-400e-ad7b-9c6b2654833c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:32:00 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-1191b0f5-0e9b-48b9-9433-d97c4e89f640 tempest-AttachVolumeTestJSON-1784642411 None] Acquiring lock "cinder-quobyte-1eb7c6aa-9096-400e-ad7b-9c6b2654833c" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:32:01 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-1191b0f5-0e9b-48b9-9433-d97c4e89f640 tempest-AttachVolumeTestJSON-1784642411 None] Lock "cinder-quobyte-1eb7c6aa-9096-400e-ad7b-9c6b2654833c" acquired by "delete_volume" :: waited 0.027s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:32:01 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9f4e5b-fa6c-4c8a-b44a-00b4edf55c91]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:32:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1191b0f5-0e9b-48b9-9433-d97c4e89f640 tempest-AttachVolumeTestJSON-1784642411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1eb7c6aa-9096-400e-ad7b-9c6b2654833c {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:01 devstack sudo[91913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1eb7c6aa-9096-400e-ad7b-9c6b2654833c Nov 02 15:32:01 devstack sudo[91913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5064b61f-dd2f-4abb-8d0e-50eeb4b839df tempest-VolumesDeleteCascade-1219762349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:32:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5064b61f-dd2f-4abb-8d0e-50eeb4b839df tempest-VolumesDeleteCascade-1219762349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:32:01 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-5064b61f-dd2f-4abb-8d0e-50eeb4b839df tempest-VolumesDeleteCascade-1219762349 None] Creating offline snapshot 057daa60-f342-423e-b5d4-5afb3a8d35de of volume e2e5d9ef-45a2-4974-b9b7-8e6685bc1348 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:32:01 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdae29a2-7c75-4e79-b1c8-bce0da5db5db]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:32:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5064b61f-dd2f-4abb-8d0e-50eeb4b839df tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:01 devstack sudo[91915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348 Nov 02 15:32:01 devstack sudo[91915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:01 devstack sudo[91913]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1191b0f5-0e9b-48b9-9433-d97c4e89f640 tempest-AttachVolumeTestJSON-1784642411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1eb7c6aa-9096-400e-ad7b-9c6b2654833c" returned: 0 in 0.621s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1191b0f5-0e9b-48b9-9433-d97c4e89f640 tempest-AttachVolumeTestJSON-1784642411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1eb7c6aa-9096-400e-ad7b-9c6b2654833c {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:01 devstack sudo[91920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1eb7c6aa-9096-400e-ad7b-9c6b2654833c Nov 02 15:32:01 devstack sudo[91920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:01 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-e89db06c-5640-4fe9-8b93-e6fd51a64bc8 req-1a57fc2c-6aba-49bc-9b99-4e760c4fe92d tempest-ServerActionsTestOtherA-1672913331 None] Terminate volume connection completed successfully. Nov 02 15:32:01 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-e89db06c-5640-4fe9-8b93-e6fd51a64bc8 req-1a57fc2c-6aba-49bc-9b99-4e760c4fe92d tempest-ServerActionsTestOtherA-1672913331 None] Deleting attachment 759e6cfd-5b44-4081-8d85-39a3f4d3939a. {{(pid=86703) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 15:32:02 devstack sudo[91920]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1191b0f5-0e9b-48b9-9433-d97c4e89f640 tempest-AttachVolumeTestJSON-1784642411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1eb7c6aa-9096-400e-ad7b-9c6b2654833c" returned: 0 in 0.323s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:02 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-1191b0f5-0e9b-48b9-9433-d97c4e89f640 tempest-AttachVolumeTestJSON-1784642411 None] Lock "cinder-quobyte-1eb7c6aa-9096-400e-ad7b-9c6b2654833c" released by "delete_volume" :: held 1.020s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:32:02 devstack sudo[91915]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5064b61f-dd2f-4abb-8d0e-50eeb4b839df tempest-VolumesDeleteCascade-1219762349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348" returned: 0 in 0.584s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5064b61f-dd2f-4abb-8d0e-50eeb4b839df tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.057daa60-f342-423e-b5d4-5afb3a8d35de 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:02 devstack sudo[91929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.057daa60-f342-423e-b5d4-5afb3a8d35de 1G Nov 02 15:32:02 devstack sudo[91929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:02 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-1191b0f5-0e9b-48b9-9433-d97c4e89f640 tempest-AttachVolumeTestJSON-1784642411 None] Created reservations ['834fb5a8-6382-4399-80fd-32f5663cd017', 'd69717cc-15f1-48b1-8aec-5e6ef009dde9', '894a1916-7d78-4678-9ef3-99a891eeb0ef', '95a9c6fb-e636-47bd-bbba-65911d6a1e2e'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:32:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1191b0f5-0e9b-48b9-9433-d97c4e89f640 tempest-AttachVolumeTestJSON-1784642411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:32:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1191b0f5-0e9b-48b9-9433-d97c4e89f640 tempest-AttachVolumeTestJSON-1784642411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:32:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1191b0f5-0e9b-48b9-9433-d97c4e89f640 tempest-AttachVolumeTestJSON-1784642411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:32:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1191b0f5-0e9b-48b9-9433-d97c4e89f640 tempest-AttachVolumeTestJSON-1784642411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:32:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1191b0f5-0e9b-48b9-9433-d97c4e89f640 tempest-AttachVolumeTestJSON-1784642411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:32:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1191b0f5-0e9b-48b9-9433-d97c4e89f640 tempest-AttachVolumeTestJSON-1784642411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:02 devstack sudo[91931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:32:02 devstack sudo[91931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:02 devstack sudo[91931]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1191b0f5-0e9b-48b9-9433-d97c4e89f640 tempest-AttachVolumeTestJSON-1784642411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.350s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:02 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-1191b0f5-0e9b-48b9-9433-d97c4e89f640 tempest-AttachVolumeTestJSON-1784642411 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:32:02 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-1191b0f5-0e9b-48b9-9433-d97c4e89f640 tempest-AttachVolumeTestJSON-1784642411 None] Deleted volume successfully. Nov 02 15:32:02 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-1191b0f5-0e9b-48b9-9433-d97c4e89f640 tempest-AttachVolumeTestJSON-1784642411 None] Lock "cinder-1eb7c6aa-9096-400e-ad7b-9c6b2654833c-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:32:02 devstack sudo[91929]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5064b61f-dd2f-4abb-8d0e-50eeb4b839df tempest-VolumesDeleteCascade-1219762349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.057daa60-f342-423e-b5d4-5afb3a8d35de 1G" returned: 0 in 0.594s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5064b61f-dd2f-4abb-8d0e-50eeb4b839df tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.057daa60-f342-423e-b5d4-5afb3a8d35de {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:02 devstack sudo[91944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.057daa60-f342-423e-b5d4-5afb3a8d35de Nov 02 15:32:02 devstack sudo[91944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:03 devstack sudo[91944]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5064b61f-dd2f-4abb-8d0e-50eeb4b839df tempest-VolumesDeleteCascade-1219762349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.057daa60-f342-423e-b5d4-5afb3a8d35de" returned: 0 in 0.359s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:03 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-5064b61f-dd2f-4abb-8d0e-50eeb4b839df tempest-VolumesDeleteCascade-1219762349 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.057daa60-f342-423e-b5d4-5afb3a8d35de is being set with open permissions: ugo+rw Nov 02 15:32:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5064b61f-dd2f-4abb-8d0e-50eeb4b839df tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.057daa60-f342-423e-b5d4-5afb3a8d35de {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:03 devstack sudo[91958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.057daa60-f342-423e-b5d4-5afb3a8d35de Nov 02 15:32:03 devstack sudo[91958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:03 devstack sudo[91958]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-78c059d4-e8e7-4389-a2dd-3ba58bdfb0b6 tempest-AttachVolumeTestJSON-1784642411 None] Acquiring lock "cinder-b21a50a0-70ef-42a5-a3bd-a27666aac5b9-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:32:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5064b61f-dd2f-4abb-8d0e-50eeb4b839df tempest-VolumesDeleteCascade-1219762349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.057daa60-f342-423e-b5d4-5afb3a8d35de" returned: 0 in 0.402s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-78c059d4-e8e7-4389-a2dd-3ba58bdfb0b6 tempest-AttachVolumeTestJSON-1784642411 None] Lock "cinder-b21a50a0-70ef-42a5-a3bd-a27666aac5b9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:32:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5064b61f-dd2f-4abb-8d0e-50eeb4b839df tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-78c059d4-e8e7-4389-a2dd-3ba58bdfb0b6 tempest-AttachVolumeTestJSON-1784642411 None] Acquiring lock "cinder-quobyte-b21a50a0-70ef-42a5-a3bd-a27666aac5b9" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:32:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-78c059d4-e8e7-4389-a2dd-3ba58bdfb0b6 tempest-AttachVolumeTestJSON-1784642411 None] Lock "cinder-quobyte-b21a50a0-70ef-42a5-a3bd-a27666aac5b9" acquired by "delete_volume" :: waited 0.017s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:32:03 devstack sudo[91973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.info Nov 02 15:32:03 devstack sudo[91973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:03 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc19f5e9-568c-4015-ba1a-41d792e73c38]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:32:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-78c059d4-e8e7-4389-a2dd-3ba58bdfb0b6 tempest-AttachVolumeTestJSON-1784642411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b21a50a0-70ef-42a5-a3bd-a27666aac5b9 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:03 devstack sudo[91975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b21a50a0-70ef-42a5-a3bd-a27666aac5b9 Nov 02 15:32:03 devstack sudo[91975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:03 devstack sudo[91973]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5064b61f-dd2f-4abb-8d0e-50eeb4b839df tempest-VolumesDeleteCascade-1219762349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.info" returned: 0 in 0.284s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:03 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-5064b61f-dd2f-4abb-8d0e-50eeb4b839df tempest-VolumesDeleteCascade-1219762349 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.info is being set with open permissions: ugo+rw Nov 02 15:32:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5064b61f-dd2f-4abb-8d0e-50eeb4b839df tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:03 devstack sudo[91978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.info Nov 02 15:32:03 devstack sudo[91978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:04 devstack sudo[91975]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-78c059d4-e8e7-4389-a2dd-3ba58bdfb0b6 tempest-AttachVolumeTestJSON-1784642411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b21a50a0-70ef-42a5-a3bd-a27666aac5b9" returned: 0 in 0.447s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-78c059d4-e8e7-4389-a2dd-3ba58bdfb0b6 tempest-AttachVolumeTestJSON-1784642411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b21a50a0-70ef-42a5-a3bd-a27666aac5b9 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:04 devstack sudo[91983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b21a50a0-70ef-42a5-a3bd-a27666aac5b9 Nov 02 15:32:04 devstack sudo[91983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:04 devstack sudo[91978]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5064b61f-dd2f-4abb-8d0e-50eeb4b839df tempest-VolumesDeleteCascade-1219762349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.info" returned: 0 in 0.403s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5064b61f-dd2f-4abb-8d0e-50eeb4b839df tempest-VolumesDeleteCascade-1219762349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.897s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:32:04 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-5064b61f-dd2f-4abb-8d0e-50eeb4b839df tempest-VolumesDeleteCascade-1219762349 None] Create snapshot completed successfully Nov 02 15:32:04 devstack sudo[91983]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-78c059d4-e8e7-4389-a2dd-3ba58bdfb0b6 tempest-AttachVolumeTestJSON-1784642411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b21a50a0-70ef-42a5-a3bd-a27666aac5b9" returned: 0 in 0.413s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:04 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-78c059d4-e8e7-4389-a2dd-3ba58bdfb0b6 tempest-AttachVolumeTestJSON-1784642411 None] Lock "cinder-quobyte-b21a50a0-70ef-42a5-a3bd-a27666aac5b9" released by "delete_volume" :: held 0.977s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:32:04 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-78c059d4-e8e7-4389-a2dd-3ba58bdfb0b6 tempest-AttachVolumeTestJSON-1784642411 None] Created reservations ['92d9f6bd-16c1-45fc-bb51-d2ed389efb1a', '0473eb9a-aed2-4ec0-9564-7838901bab87', '34a1fcc3-2d08-4fb1-9d07-5cdb0111a3cc', '4cc77693-73e2-4fca-baa2-5af5300e02b1'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:32:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-78c059d4-e8e7-4389-a2dd-3ba58bdfb0b6 tempest-AttachVolumeTestJSON-1784642411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:32:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-78c059d4-e8e7-4389-a2dd-3ba58bdfb0b6 tempest-AttachVolumeTestJSON-1784642411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:32:04 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-78c059d4-e8e7-4389-a2dd-3ba58bdfb0b6 tempest-AttachVolumeTestJSON-1784642411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:32:04 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-78c059d4-e8e7-4389-a2dd-3ba58bdfb0b6 tempest-AttachVolumeTestJSON-1784642411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:32:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-78c059d4-e8e7-4389-a2dd-3ba58bdfb0b6 tempest-AttachVolumeTestJSON-1784642411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:32:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-78c059d4-e8e7-4389-a2dd-3ba58bdfb0b6 tempest-AttachVolumeTestJSON-1784642411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:04 devstack sudo[91996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:32:04 devstack sudo[91996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7bd578e8-58ce-4e39-a578-2dd4b5c08864 tempest-VolumesDeleteCascade-1219762349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:32:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7bd578e8-58ce-4e39-a578-2dd4b5c08864 tempest-VolumesDeleteCascade-1219762349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:32:04 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-7bd578e8-58ce-4e39-a578-2dd4b5c08864 tempest-VolumesDeleteCascade-1219762349 None] Creating offline snapshot 41f65966-1821-48f4-a61a-02eb947e172b of volume e2e5d9ef-45a2-4974-b9b7-8e6685bc1348 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:32:04 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[60146c86-caba-492a-9dfa-f35595758eba]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:32:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7bd578e8-58ce-4e39-a578-2dd4b5c08864 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.057daa60-f342-423e-b5d4-5afb3a8d35de {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:05 devstack sudo[91996]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:05 devstack sudo[91998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.057daa60-f342-423e-b5d4-5afb3a8d35de Nov 02 15:32:05 devstack sudo[91998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-78c059d4-e8e7-4389-a2dd-3ba58bdfb0b6 tempest-AttachVolumeTestJSON-1784642411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.316s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:05 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-78c059d4-e8e7-4389-a2dd-3ba58bdfb0b6 tempest-AttachVolumeTestJSON-1784642411 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:32:05 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-78c059d4-e8e7-4389-a2dd-3ba58bdfb0b6 tempest-AttachVolumeTestJSON-1784642411 None] Deleted volume successfully. Nov 02 15:32:05 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-78c059d4-e8e7-4389-a2dd-3ba58bdfb0b6 tempest-AttachVolumeTestJSON-1784642411 None] Lock "cinder-b21a50a0-70ef-42a5-a3bd-a27666aac5b9-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:32:05 devstack sudo[91998]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7bd578e8-58ce-4e39-a578-2dd4b5c08864 tempest-VolumesDeleteCascade-1219762349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.057daa60-f342-423e-b5d4-5afb3a8d35de" returned: 0 in 0.514s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:05 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-7bd578e8-58ce-4e39-a578-2dd4b5c08864 tempest-VolumesDeleteCascade-1219762349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:32:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7bd578e8-58ce-4e39-a578-2dd4b5c08864 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.057daa60-f342-423e-b5d4-5afb3a8d35de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.41f65966-1821-48f4-a61a-02eb947e172b 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:05 devstack sudo[92005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.057daa60-f342-423e-b5d4-5afb3a8d35de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.41f65966-1821-48f4-a61a-02eb947e172b 1G Nov 02 15:32:05 devstack sudo[92005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:06 devstack sudo[92005]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7bd578e8-58ce-4e39-a578-2dd4b5c08864 tempest-VolumesDeleteCascade-1219762349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.057daa60-f342-423e-b5d4-5afb3a8d35de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.41f65966-1821-48f4-a61a-02eb947e172b 1G" returned: 0 in 0.723s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7bd578e8-58ce-4e39-a578-2dd4b5c08864 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.057daa60-f342-423e-b5d4-5afb3a8d35de -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.41f65966-1821-48f4-a61a-02eb947e172b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:06 devstack sudo[92012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.057daa60-f342-423e-b5d4-5afb3a8d35de -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.41f65966-1821-48f4-a61a-02eb947e172b Nov 02 15:32:06 devstack sudo[92012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:06 devstack sudo[92012]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7bd578e8-58ce-4e39-a578-2dd4b5c08864 tempest-VolumesDeleteCascade-1219762349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.057daa60-f342-423e-b5d4-5afb3a8d35de -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.41f65966-1821-48f4-a61a-02eb947e172b" returned: 0 in 0.380s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:06 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-7bd578e8-58ce-4e39-a578-2dd4b5c08864 tempest-VolumesDeleteCascade-1219762349 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.41f65966-1821-48f4-a61a-02eb947e172b is being set with open permissions: ugo+rw Nov 02 15:32:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7bd578e8-58ce-4e39-a578-2dd4b5c08864 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.41f65966-1821-48f4-a61a-02eb947e172b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:06 devstack sudo[92017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.41f65966-1821-48f4-a61a-02eb947e172b Nov 02 15:32:06 devstack sudo[92017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:06 devstack sudo[92017]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7bd578e8-58ce-4e39-a578-2dd4b5c08864 tempest-VolumesDeleteCascade-1219762349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.41f65966-1821-48f4-a61a-02eb947e172b" returned: 0 in 0.293s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7bd578e8-58ce-4e39-a578-2dd4b5c08864 tempest-VolumesDeleteCascade-1219762349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.047s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:32:06 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-7bd578e8-58ce-4e39-a578-2dd4b5c08864 tempest-VolumesDeleteCascade-1219762349 None] Create snapshot completed successfully Nov 02 15:32:08 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Acquiring lock "cinder-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:32:08 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:32:08 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Performing cascade delete. {{(pid=86703) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 02 15:32:08 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Acquiring lock "cinder-057daa60-f342-423e-b5d4-5afb3a8d35de-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:32:08 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-057daa60-f342-423e-b5d4-5afb3a8d35de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:32:08 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Acquiring lock "cinder-quobyte-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:32:08 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-quobyte-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:32:08 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Acquiring lock "cinder-quobyte-057daa60-f342-423e-b5d4-5afb3a8d35de" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:32:08 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-quobyte-057daa60-f342-423e-b5d4-5afb3a8d35de" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:32:08 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Deleting offline snapshot 057daa60-f342-423e-b5d4-5afb3a8d35de of volume e2e5d9ef-45a2-4974-b9b7-8e6685bc1348 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:32:08 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] snapshot_file for this snap is: volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.057daa60-f342-423e-b5d4-5afb3a8d35de {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:32:08 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c96671-111c-472f-a34a-e1274495b398]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:32:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.057daa60-f342-423e-b5d4-5afb3a8d35de {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:08 devstack sudo[92022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.057daa60-f342-423e-b5d4-5afb3a8d35de Nov 02 15:32:08 devstack sudo[92022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:08 devstack sudo[92022]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.057daa60-f342-423e-b5d4-5afb3a8d35de" returned: 0 in 0.476s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:08 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:32:08 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4818db9b-6727-49ac-affd-0b606c658bde]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:32:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:09 devstack sudo[92027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348 Nov 02 15:32:09 devstack sudo[92027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:09 devstack sudo[92027]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348" returned: 0 in 0.412s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:09 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35dd1c8-eda0-4815-b053-686f02fb65a5]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:32:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.41f65966-1821-48f4-a61a-02eb947e172b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:09 devstack sudo[92032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.41f65966-1821-48f4-a61a-02eb947e172b Nov 02 15:32:09 devstack sudo[92032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:09 devstack sudo[92032]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.41f65966-1821-48f4-a61a-02eb947e172b" returned: 0 in 0.551s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:09 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:32:09 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79c7db9-121e-47e1-bb7b-9e617dd20b61]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:32:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.057daa60-f342-423e-b5d4-5afb3a8d35de {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:10 devstack sudo[92037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.057daa60-f342-423e-b5d4-5afb3a8d35de Nov 02 15:32:10 devstack sudo[92037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:10 devstack sudo[92037]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.057daa60-f342-423e-b5d4-5afb3a8d35de" returned: 0 in 0.457s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:32:10 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[636de41b-c713-40ba-bd7f-1f042fecb42c]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:32:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:10 devstack sudo[92042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348 Nov 02 15:32:10 devstack sudo[92042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:10 devstack sudo[92042]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348" returned: 0 in 0.415s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.057daa60-f342-423e-b5d4-5afb3a8d35de {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:10 devstack sudo[92048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.057daa60-f342-423e-b5d4-5afb3a8d35de Nov 02 15:32:10 devstack sudo[92048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:11 devstack sudo[92048]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.057daa60-f342-423e-b5d4-5afb3a8d35de" returned: 0 in 0.516s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.057daa60-f342-423e-b5d4-5afb3a8d35de {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:11 devstack sudo[92056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.057daa60-f342-423e-b5d4-5afb3a8d35de Nov 02 15:32:11 devstack sudo[92056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:11 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:32:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Flow 'volume_create_manager' (c4d188f6-8281-4639-b003-0b82ba33cbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:32:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93daa3f3-3c61-4047-8d41-448a512cc3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93daa3f3-3c61-4047-8d41-448a512cc3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-781633361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e447838d-a9bf-49af-84b7-a7f2e65c9a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80826bc171e9481ea36abd9838f48b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:32:12Z,use_quota=True,user_id='796346940ff04fc89c2d39cc3c1b247c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2fb1412-e8fb-4686-8627-b326acb0b8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2fb1412-e8fb-4686-8627-b326acb0b8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85f8a2fc-7371-48ac-943b-568c6eab6490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:11 devstack cinder-volume[86703]: DEBUG cinder.image.glance [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Creating Keystone auth plugin from conf {{(pid=86703) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 15:32:11 devstack sudo[92056]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.057daa60-f342-423e-b5d4-5afb3a8d35de" returned: 0 in 0.395s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.41f65966-1821-48f4-a61a-02eb947e172b -F qcow2 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:11 devstack sudo[92060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.41f65966-1821-48f4-a61a-02eb947e172b -F qcow2 Nov 02 15:32:11 devstack sudo[92060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:12 devstack sudo[92060]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.41f65966-1821-48f4-a61a-02eb947e172b -F qcow2" returned: 0 in 0.452s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:12 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-quobyte-057daa60-f342-423e-b5d4-5afb3a8d35de" released by "_delete_snapshot" :: held 3.965s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:32:12 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-quobyte-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348" released by "delete_snapshot" :: held 4.007s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:32:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85f8a2fc-7371-48ac-943b-568c6eab6490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e447838d-a9bf-49af-84b7-a7f2e65c9a5d', 'volume_name': 'volume-e447838d-a9bf-49af-84b7-a7f2e65c9a5d', 'volume_size': 1, 'image_id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '583ef2b19215459298db002053800c52', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'created_at': datetime.datetime(2026, 11, 2, 14, 23, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 14, 23, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa69524-5bdc-454d-b143-4ecd8922039e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fa69524-5bdc-454d-b143-4ecd8922039e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d49abb5e-a209-4b44-b0dd-7a40781c8bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:12 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Volume e447838d-a9bf-49af-84b7-a7f2e65c9a5d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e447838d-a9bf-49af-84b7-a7f2e65c9a5d', 'volume_size': 1, 'image_id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '583ef2b19215459298db002053800c52', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'created_at': datetime.datetime(2026, 11, 2, 14, 23, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 14, 23, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 15:32:12 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Trying to clone e447838d-a9bf-49af-84b7-a7f2e65c9a5d from image 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 at location (None, [{'url': 'file:///opt/stack/data/glance/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'metadata': {}}]). {{(pid=86703) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 15:32:12 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=102,cinder:UPDATE=80,cinder:INSERT=17,cinder:DELETE=7 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:32:12 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Created reservations ['fb1b31e9-4197-408f-a16d-3be6693686df', '2e977aca-3038-4f85-8b28-9c55674194a5', 'f4a92646-25a3-4191-9675-0ad073265fc6', 'c8c09b69-ae5d-4d54-ade7-3284a334740b'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:32:12 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Delete snapshot completed successfully. Nov 02 15:32:12 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-057daa60-f342-423e-b5d4-5afb3a8d35de-delete_snapshot" released by "delete_snapshot" :: held 4.493s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:32:12 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Acquiring lock "cinder-41f65966-1821-48f4-a61a-02eb947e172b-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:32:12 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-41f65966-1821-48f4-a61a-02eb947e172b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:32:12 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Acquiring lock "cinder-quobyte-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:32:12 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-quobyte-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:32:12 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Acquiring lock "cinder-quobyte-41f65966-1821-48f4-a61a-02eb947e172b" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:32:12 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-quobyte-41f65966-1821-48f4-a61a-02eb947e172b" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:32:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Deleting offline snapshot 41f65966-1821-48f4-a61a-02eb947e172b of volume e2e5d9ef-45a2-4974-b9b7-8e6685bc1348 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:32:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] snapshot_file for this snap is: volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.41f65966-1821-48f4-a61a-02eb947e172b {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:32:12 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ebd78b-9ca6-4175-a716-0f8b254e5fd3]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:32:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.41f65966-1821-48f4-a61a-02eb947e172b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:13 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_t853j_51devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86703) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 15:32:13 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Image download 20.69 MB at 20.69 MB/s Nov 02 15:32:13 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e1622c-8745-41e3-b417-1cc1cfca5a3f]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:32:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_t853j_51devstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:13 devstack sudo[92090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.41f65966-1821-48f4-a61a-02eb947e172b Nov 02 15:32:13 devstack sudo[92090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:13 devstack sudo[92092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_t853j_51devstack@QuobyteHD Nov 02 15:32:13 devstack sudo[92092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:13 devstack sudo[92090]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.41f65966-1821-48f4-a61a-02eb947e172b" returned: 0 in 0.657s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:13 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:32:13 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[897b12b8-3f0e-41a0-b364-a03a65c5e2bf]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:32:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:13 devstack sudo[92092]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_t853j_51devstack@QuobyteHD" returned: 0 in 0.713s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:13 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Temporary image 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 is fetched for user 796346940ff04fc89c2d39cc3c1b247c. {{(pid=86703) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 15:32:13 devstack sudo[92101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348 Nov 02 15:32:13 devstack sudo[92101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:13 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=98,cinder:UPDATE=87,cinder:INSERT=22,cinder:DELETE=7 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:32:14 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[20eec020-5cd5-4420-809a-bb793211d374]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:32:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_t853j_51devstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:14 devstack sudo[92107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_t853j_51devstack@QuobyteHD Nov 02 15:32:14 devstack sudo[92107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:14 devstack sudo[92101]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348" returned: 0 in 0.621s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.41f65966-1821-48f4-a61a-02eb947e172b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:14 devstack sudo[92120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.41f65966-1821-48f4-a61a-02eb947e172b Nov 02 15:32:14 devstack sudo[92120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:14 devstack sudo[92107]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_t853j_51devstack@QuobyteHD" returned: 0 in 0.647s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:32:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:32:14 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-781633361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e447838d-a9bf-49af-84b7-a7f2e65c9a5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80826bc171e9481ea36abd9838f48b18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:32:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:32:12Z,use_quota=True,user_id='796346940ff04fc89c2d39cc3c1b247c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:32:14 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Creating volume e447838d-a9bf-49af-84b7-a7f2e65c9a5d {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:32:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:32:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:32:14 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:32:14 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:32:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:32:14 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:32:14 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:32:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e447838d-a9bf-49af-84b7-a7f2e65c9a5d 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:14 devstack sudo[92128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e447838d-a9bf-49af-84b7-a7f2e65c9a5d 1073741824 Nov 02 15:32:14 devstack sudo[92128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:15 devstack sudo[92120]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.41f65966-1821-48f4-a61a-02eb947e172b" returned: 0 in 0.715s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.41f65966-1821-48f4-a61a-02eb947e172b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:15 devstack sudo[92138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.41f65966-1821-48f4-a61a-02eb947e172b Nov 02 15:32:15 devstack sudo[92138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:15 devstack sudo[92138]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348.41f65966-1821-48f4-a61a-02eb947e172b" returned: 0 in 0.415s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:15 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-quobyte-41f65966-1821-48f4-a61a-02eb947e172b" released by "_delete_snapshot" :: held 2.663s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:32:15 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-quobyte-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348" released by "delete_snapshot" :: held 2.719s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:32:15 devstack sudo[92128]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e447838d-a9bf-49af-84b7-a7f2e65c9a5d 1073741824" returned: 0 in 0.898s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:15 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Created reservations ['8a4da18b-0917-433d-a4cd-b29d367b8ab8', '1dd108a6-4a6f-4a5c-8e33-ff99974630e5', '4cabc8c8-93a5-4ce2-a2da-a64781060374', '3fdc32c9-a3b2-43fe-b620-7ea272395bd9'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:32:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e447838d-a9bf-49af-84b7-a7f2e65c9a5d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:15 devstack sudo[92145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e447838d-a9bf-49af-84b7-a7f2e65c9a5d Nov 02 15:32:15 devstack sudo[92145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:15 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Delete snapshot completed successfully. Nov 02 15:32:15 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-41f65966-1821-48f4-a61a-02eb947e172b-delete_snapshot" released by "delete_snapshot" :: held 3.016s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:32:15 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Snapshots deleted, issuing volume delete {{(pid=86703) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 02 15:32:15 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Acquiring lock "cinder-quobyte-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:32:15 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-quobyte-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348" acquired by "delete_volume" :: waited 0.029s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:32:15 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1adfbdf-1033-40cb-9305-11a2286c0648]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:32:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:16 devstack sudo[92152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348 Nov 02 15:32:16 devstack sudo[92152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:16 devstack sudo[92145]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e447838d-a9bf-49af-84b7-a7f2e65c9a5d" returned: 0 in 0.574s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:16 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:32:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:32:16 devstack cinder-volume[86703]: DEBUG cinder.volume.volume_utils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Attempting download of 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 ((None, [{'url': 'file:///opt/stack/data/glance/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'metadata': {}}])) to volume e447838d-a9bf-49af-84b7-a7f2e65c9a5d. {{(pid=86703) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 15:32:16 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[57933e1f-1b97-45b4-afb9-02d2ca1ab5c8]: (4, 'raw') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:32:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_vetwknut {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:16 devstack sudo[92152]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348" returned: 0 in 0.710s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:16 devstack sudo[92170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_vetwknut Nov 02 15:32:16 devstack sudo[92170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:16 devstack sudo[92174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348 Nov 02 15:32:16 devstack sudo[92174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:17 devstack sudo[92170]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_vetwknut" returned: 0 in 0.599s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_vetwknut {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:17 devstack sudo[92174]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348" returned: 0 in 0.514s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:17 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-quobyte-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348" released by "delete_volume" :: held 1.372s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:32:17 devstack sudo[92180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_vetwknut Nov 02 15:32:17 devstack sudo[92180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:17 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Created reservations ['bb99a5a6-66cb-4c7c-8353-59d2f24d9d5f', '1b3115a6-71b9-4ad3-a2b4-74ccd051ebe2', 'a08c4ee0-b072-43d5-9b2b-a60a469bf16a', 'a2ee9aee-2762-49ff-a03e-49de55955a64'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:32:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:32:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:32:17 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:32:17 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:32:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:32:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:17 devstack sudo[92180]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_vetwknut" returned: 1 in 0.500s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_vetwknut' failed. Not Retrying. {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 15:32:17 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a52a9c-c446-4212-8532-2ab12ec8dde5]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:32:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_t853j_51devstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:17 devstack sudo[92185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:32:17 devstack sudo[92185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:17 devstack sudo[92187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_t853j_51devstack@QuobyteHD Nov 02 15:32:17 devstack sudo[92187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:17 devstack sudo[92185]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.365s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:17 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:32:17 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Deleted volume successfully. Nov 02 15:32:17 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b5c326af-8955-4707-a2c8-4a0608293c57 tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-e2e5d9ef-45a2-4974-b9b7-8e6685bc1348-delete_volume" released by "delete_volume" :: held 9.788s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:32:18 devstack sudo[92187]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_t853j_51devstack@QuobyteHD" returned: 0 in 0.480s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:18 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 was qcow2, converting to qcow2 {{(pid=86703) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 15:32:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_t853j_51devstack@QuobyteHD /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e447838d-a9bf-49af-84b7-a7f2e65c9a5d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:18 devstack sudo[92193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_t853j_51devstack@QuobyteHD /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e447838d-a9bf-49af-84b7-a7f2e65c9a5d Nov 02 15:32:18 devstack sudo[92193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:18 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:32:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] Flow 'volume_create_manager' (a116decb-eb58-40a6-904a-541777615f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:32:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f048b96-b4d5-4ff8-a393-1f88e6fd8258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f048b96-b4d5-4ff8-a393-1f88e6fd8258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-781876815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68a73b00-e4b3-4b42-9640-30c41391f03a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0488dbc1e8be452dab279adb193c50b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:32:18Z,use_quota=True,user_id='55021569c37c47c689e22c19f5b442bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3afc06e6-757f-490b-b1e7-bf05805c38ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3afc06e6-757f-490b-b1e7-bf05805c38ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c80c46b-a86b-46db-8f92-b16b91195380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c80c46b-a86b-46db-8f92-b16b91195380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68a73b00-e4b3-4b42-9640-30c41391f03a', 'volume_name': 'volume-68a73b00-e4b3-4b42-9640-30c41391f03a', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (218fe964-9f38-4a89-8da6-94ce77a8f611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (218fe964-9f38-4a89-8da6-94ce77a8f611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb900eaf-6e93-4e8d-943b-45019658c5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:18 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] Volume 68a73b00-e4b3-4b42-9640-30c41391f03a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68a73b00-e4b3-4b42-9640-30c41391f03a', 'volume_size': 1} Nov 02 15:32:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:32:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:32:18 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:32:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-781876815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68a73b00-e4b3-4b42-9640-30c41391f03a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0488dbc1e8be452dab279adb193c50b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:32:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:32:18Z,use_quota=True,user_id='55021569c37c47c689e22c19f5b442bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:32:18 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] Creating volume 68a73b00-e4b3-4b42-9640-30c41391f03a {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:32:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:32:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:32:18 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:32:18 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:32:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:32:18 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:32:18 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:32:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:18 devstack sudo[92208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a 1073741824 Nov 02 15:32:18 devstack sudo[92208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:19 devstack sudo[92208]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a 1073741824" returned: 0 in 1.087s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:19 devstack sudo[92266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a Nov 02 15:32:19 devstack sudo[92266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:20 devstack sudo[92266]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a" returned: 0 in 0.683s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:32:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:32:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb900eaf-6e93-4e8d-943b-45019658c5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68a73b00-e4b3-4b42-9640-30c41391f03a', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7d0a7e-c444-4d7e-b9ab-14b57992c6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:20 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] Volume volume-68a73b00-e4b3-4b42-9640-30c41391f03a (68a73b00-e4b3-4b42-9640-30c41391f03a): created successfully Nov 02 15:32:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7d0a7e-c444-4d7e-b9ab-14b57992c6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] Flow 'volume_create_manager' (a116decb-eb58-40a6-904a-541777615f4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:32:20 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-34d7cac2-3082-4003-9d2c-14cd6d06144e req-25b972f2-649d-4d2a-829f-4cdbd2cd5081 tempest-VolumesSnapshotsTestJSON-977320371 None] Created volume successfully. Nov 02 15:32:20 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:32:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:32:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:32:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:32:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:32:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:32:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:20 devstack sudo[92276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:32:20 devstack sudo[92276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:21 devstack sudo[92276]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.583s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:21 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:32:21 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager._thread_info {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:32:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread count: 28 {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 15:32:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread info: [<_MainThread(MainThread, started 125876361756800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 15:32:21 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:32:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] Flow 'volume_create_manager' (8739247e-5e51-442d-bb59-bc7c3c37ab78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:32:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fd4de91-3d6c-495d-bd86-cbdef086c461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fd4de91-3d6c-495d-bd86-cbdef086c461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-884140868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd40b4ad-d4a7-4d34-a47d-7b933561d320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fec202c2de54ba790f44c99e0a28493',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:32:21Z,use_quota=True,user_id='8350f6dc69a24e90aceda39ce7809e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7981fde2-be60-4398-9261-6623adbf46fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7981fde2-be60-4398-9261-6623adbf46fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ba92173-9838-4271-ba7b-01a331ded6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ba92173-9838-4271-ba7b-01a331ded6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd40b4ad-d4a7-4d34-a47d-7b933561d320', 'volume_name': 'volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168ef488-b5b6-4349-b2fb-d97b86d0ec22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168ef488-b5b6-4349-b2fb-d97b86d0ec22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d4f4511-8269-4130-9f07-2c299e148c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:21 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] Volume dd40b4ad-d4a7-4d34-a47d-7b933561d320: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320', 'volume_size': 1} Nov 02 15:32:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:32:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:32:21 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-884140868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd40b4ad-d4a7-4d34-a47d-7b933561d320,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fec202c2de54ba790f44c99e0a28493',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:32:21Z,use_quota=True,user_id='8350f6dc69a24e90aceda39ce7809e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:32:21 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] Creating volume dd40b4ad-d4a7-4d34-a47d-7b933561d320 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:32:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:32:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:32:21 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:32:21 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:32:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:32:21 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:32:21 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:32:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:21 devstack sudo[92301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320 1073741824 Nov 02 15:32:21 devstack sudo[92301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-f4998e18-4917-4f54-a83c-042775804389 req-d0d59986-1875-43ac-ad4a-c508138654fa tempest-VolumesSnapshotsTestJSON-977320371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:32:22 devstack sudo[92193]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_t853j_51devstack@QuobyteHD /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e447838d-a9bf-49af-84b7-a7f2e65c9a5d" returned: 0 in 4.495s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:22 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_t853j_51devstack@QuobyteHD, size 112.00 MB, duration 4.50 sec, destination /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e447838d-a9bf-49af-84b7-a7f2e65c9a5d {{(pid=86703) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 15:32:22 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Converted 112.00 MB image at 24.90 MB/s Nov 02 15:32:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e447838d-a9bf-49af-84b7-a7f2e65c9a5d 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:22 devstack sudo[92324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e447838d-a9bf-49af-84b7-a7f2e65c9a5d 1G Nov 02 15:32:22 devstack sudo[92324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:22 devstack sudo[92301]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320 1073741824" returned: 0 in 1.116s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:22 devstack sudo[92327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320 Nov 02 15:32:22 devstack sudo[92327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:23 devstack sudo[92324]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e447838d-a9bf-49af-84b7-a7f2e65c9a5d 1G" returned: 0 in 0.610s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:23 devstack cinder-volume[86703]: DEBUG cinder.volume.volume_utils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Downloaded image 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 ((None, [{'url': 'file:///opt/stack/data/glance/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'metadata': {}}])) to volume e447838d-a9bf-49af-84b7-a7f2e65c9a5d successfully. {{(pid=86703) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 15:32:23 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Temporary image 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 for user 796346940ff04fc89c2d39cc3c1b247c is deleted. {{(pid=86703) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 15:32:23 devstack cinder-volume[86703]: DEBUG cinder.volume.volume_utils [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Marking volume e447838d-a9bf-49af-84b7-a7f2e65c9a5d as bootable. {{(pid=86703) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 15:32:23 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Copying metadata from image 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 to e447838d-a9bf-49af-84b7-a7f2e65c9a5d. {{(pid=86703) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 15:32:23 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Creating volume glance metadata for volume e447838d-a9bf-49af-84b7-a7f2e65c9a5d backed by image 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86703) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 15:32:23 devstack sudo[92327]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320" returned: 0 in 0.305s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:23 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:32:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:32:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-f4998e18-4917-4f54-a83c-042775804389 req-d0d59986-1875-43ac-ad4a-c508138654fa tempest-VolumesSnapshotsTestJSON-977320371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.265s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:32:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d4f4511-8269-4130-9f07-2c299e148c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d879418-68b5-4fc4-bbc5-3e5be5ad8336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:23 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [req-f4998e18-4917-4f54-a83c-042775804389 req-d0d59986-1875-43ac-ad4a-c508138654fa tempest-VolumesSnapshotsTestJSON-977320371 None] Creating offline snapshot 62e7cff8-f2a8-4ff3-b419-6e2875ecc0a2 of volume 68a73b00-e4b3-4b42-9640-30c41391f03a {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:32:23 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] Volume volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320 (dd40b4ad-d4a7-4d34-a47d-7b933561d320): created successfully Nov 02 15:32:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d879418-68b5-4fc4-bbc5-3e5be5ad8336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] Flow 'volume_create_manager' (8739247e-5e51-442d-bb59-bc7c3c37ab78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:32:23 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7b2717-7860-4ac6-8e03-cc9906e6d212]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:32:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-f4998e18-4917-4f54-a83c-042775804389 req-d0d59986-1875-43ac-ad4a-c508138654fa tempest-VolumesSnapshotsTestJSON-977320371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:23 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-f179e013-b849-4829-b7ad-91e23abf5518 tempest-VolumesDeleteCascade-1219762349 None] Created volume successfully. Nov 02 15:32:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d49abb5e-a209-4b44-b0dd-7a40781c8bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e447838d-a9bf-49af-84b7-a7f2e65c9a5d', 'volume_size': 1, 'image_id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '583ef2b19215459298db002053800c52', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'created_at': datetime.datetime(2026, 11, 2, 14, 23, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 14, 23, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ab1fd9-9720-41d6-8fc7-72c02f3cfd3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:23 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Volume volume-e447838d-a9bf-49af-84b7-a7f2e65c9a5d (e447838d-a9bf-49af-84b7-a7f2e65c9a5d): created successfully Nov 02 15:32:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ab1fd9-9720-41d6-8fc7-72c02f3cfd3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Flow 'volume_create_manager' (c4d188f6-8281-4639-b003-0b82ba33cbe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:32:23 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-358532bd-d7bb-4061-aee7-daaacd7129c1 tempest-ServerActionsTestOtherA-1672913331 None] Created volume successfully. Nov 02 15:32:23 devstack sudo[92334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a Nov 02 15:32:23 devstack sudo[92334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:23 devstack sudo[92334]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-f4998e18-4917-4f54-a83c-042775804389 req-d0d59986-1875-43ac-ad4a-c508138654fa tempest-VolumesSnapshotsTestJSON-977320371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a" returned: 0 in 0.425s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-f4998e18-4917-4f54-a83c-042775804389 req-d0d59986-1875-43ac-ad4a-c508138654fa tempest-VolumesSnapshotsTestJSON-977320371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a.62e7cff8-f2a8-4ff3-b419-6e2875ecc0a2 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:23 devstack sudo[92339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a.62e7cff8-f2a8-4ff3-b419-6e2875ecc0a2 1G Nov 02 15:32:23 devstack sudo[92339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:24 devstack sudo[92339]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-f4998e18-4917-4f54-a83c-042775804389 req-d0d59986-1875-43ac-ad4a-c508138654fa tempest-VolumesSnapshotsTestJSON-977320371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a.62e7cff8-f2a8-4ff3-b419-6e2875ecc0a2 1G" returned: 0 in 0.599s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-f4998e18-4917-4f54-a83c-042775804389 req-d0d59986-1875-43ac-ad4a-c508138654fa tempest-VolumesSnapshotsTestJSON-977320371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68a73b00-e4b3-4b42-9640-30c41391f03a -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a.62e7cff8-f2a8-4ff3-b419-6e2875ecc0a2 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:24 devstack sudo[92346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68a73b00-e4b3-4b42-9640-30c41391f03a -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a.62e7cff8-f2a8-4ff3-b419-6e2875ecc0a2 Nov 02 15:32:24 devstack sudo[92346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-12615cf0-c98b-469b-b535-63caa325c4c9 tempest-VolumesDeleteCascade-1219762349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:32:24 devstack sudo[92346]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-f4998e18-4917-4f54-a83c-042775804389 req-d0d59986-1875-43ac-ad4a-c508138654fa tempest-VolumesSnapshotsTestJSON-977320371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68a73b00-e4b3-4b42-9640-30c41391f03a -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a.62e7cff8-f2a8-4ff3-b419-6e2875ecc0a2" returned: 0 in 0.508s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:24 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [req-f4998e18-4917-4f54-a83c-042775804389 req-d0d59986-1875-43ac-ad4a-c508138654fa tempest-VolumesSnapshotsTestJSON-977320371 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a.62e7cff8-f2a8-4ff3-b419-6e2875ecc0a2 is being set with open permissions: ugo+rw Nov 02 15:32:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-f4998e18-4917-4f54-a83c-042775804389 req-d0d59986-1875-43ac-ad4a-c508138654fa tempest-VolumesSnapshotsTestJSON-977320371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a.62e7cff8-f2a8-4ff3-b419-6e2875ecc0a2 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:24 devstack sudo[92353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a.62e7cff8-f2a8-4ff3-b419-6e2875ecc0a2 Nov 02 15:32:24 devstack sudo[92353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:25 devstack sudo[92353]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-f4998e18-4917-4f54-a83c-042775804389 req-d0d59986-1875-43ac-ad4a-c508138654fa tempest-VolumesSnapshotsTestJSON-977320371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a.62e7cff8-f2a8-4ff3-b419-6e2875ecc0a2" returned: 0 in 0.376s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-f4998e18-4917-4f54-a83c-042775804389 req-d0d59986-1875-43ac-ad4a-c508138654fa tempest-VolumesSnapshotsTestJSON-977320371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:25 devstack sudo[92357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a.info Nov 02 15:32:25 devstack sudo[92357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:25 devstack sudo[92357]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-f4998e18-4917-4f54-a83c-042775804389 req-d0d59986-1875-43ac-ad4a-c508138654fa tempest-VolumesSnapshotsTestJSON-977320371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a.info" returned: 0 in 0.452s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:25 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [req-f4998e18-4917-4f54-a83c-042775804389 req-d0d59986-1875-43ac-ad4a-c508138654fa tempest-VolumesSnapshotsTestJSON-977320371 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a.info is being set with open permissions: ugo+rw Nov 02 15:32:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-f4998e18-4917-4f54-a83c-042775804389 req-d0d59986-1875-43ac-ad4a-c508138654fa tempest-VolumesSnapshotsTestJSON-977320371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:25 devstack sudo[92361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a.info Nov 02 15:32:25 devstack sudo[92361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:26 devstack sudo[92361]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-f4998e18-4917-4f54-a83c-042775804389 req-d0d59986-1875-43ac-ad4a-c508138654fa tempest-VolumesSnapshotsTestJSON-977320371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a.info" returned: 0 in 0.362s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-f4998e18-4917-4f54-a83c-042775804389 req-d0d59986-1875-43ac-ad4a-c508138654fa tempest-VolumesSnapshotsTestJSON-977320371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.967s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:32:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-12615cf0-c98b-469b-b535-63caa325c4c9 tempest-VolumesDeleteCascade-1219762349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.493s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:32:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-12615cf0-c98b-469b-b535-63caa325c4c9 tempest-VolumesDeleteCascade-1219762349 None] Creating offline snapshot 0fc7e772-7df9-4a3e-bf30-4e316aa3f517 of volume dd40b4ad-d4a7-4d34-a47d-7b933561d320 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:32:26 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-f4998e18-4917-4f54-a83c-042775804389 req-d0d59986-1875-43ac-ad4a-c508138654fa tempest-VolumesSnapshotsTestJSON-977320371 None] Create snapshot completed successfully Nov 02 15:32:26 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[165e2ad0-b2b9-408b-bee0-e414525bc747]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:32:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-12615cf0-c98b-469b-b535-63caa325c4c9 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:26 devstack sudo[92366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320 Nov 02 15:32:26 devstack sudo[92366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [req-0c14980a-2302-43a6-a2f9-ebb997df93d1 req-ffbae5fd-21e3-4e0c-999e-f5ffe13fe1cc tempest-VolumesSnapshotsTestJSON-977320371 None] Acquiring lock "cinder-62e7cff8-f2a8-4ff3-b419-6e2875ecc0a2-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:32:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [req-0c14980a-2302-43a6-a2f9-ebb997df93d1 req-ffbae5fd-21e3-4e0c-999e-f5ffe13fe1cc tempest-VolumesSnapshotsTestJSON-977320371 None] Lock "cinder-62e7cff8-f2a8-4ff3-b419-6e2875ecc0a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:32:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [req-0c14980a-2302-43a6-a2f9-ebb997df93d1 req-ffbae5fd-21e3-4e0c-999e-f5ffe13fe1cc tempest-VolumesSnapshotsTestJSON-977320371 None] Acquiring lock "cinder-quobyte-68a73b00-e4b3-4b42-9640-30c41391f03a" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:32:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [req-0c14980a-2302-43a6-a2f9-ebb997df93d1 req-ffbae5fd-21e3-4e0c-999e-f5ffe13fe1cc tempest-VolumesSnapshotsTestJSON-977320371 None] Lock "cinder-quobyte-68a73b00-e4b3-4b42-9640-30c41391f03a" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:32:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [req-0c14980a-2302-43a6-a2f9-ebb997df93d1 req-ffbae5fd-21e3-4e0c-999e-f5ffe13fe1cc tempest-VolumesSnapshotsTestJSON-977320371 None] Acquiring lock "cinder-quobyte-62e7cff8-f2a8-4ff3-b419-6e2875ecc0a2" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:32:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [req-0c14980a-2302-43a6-a2f9-ebb997df93d1 req-ffbae5fd-21e3-4e0c-999e-f5ffe13fe1cc tempest-VolumesSnapshotsTestJSON-977320371 None] Lock "cinder-quobyte-62e7cff8-f2a8-4ff3-b419-6e2875ecc0a2" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:32:27 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [req-0c14980a-2302-43a6-a2f9-ebb997df93d1 req-ffbae5fd-21e3-4e0c-999e-f5ffe13fe1cc tempest-VolumesSnapshotsTestJSON-977320371 None] Deleting offline snapshot 62e7cff8-f2a8-4ff3-b419-6e2875ecc0a2 of volume 68a73b00-e4b3-4b42-9640-30c41391f03a {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:32:27 devstack sudo[92366]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:27 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [req-0c14980a-2302-43a6-a2f9-ebb997df93d1 req-ffbae5fd-21e3-4e0c-999e-f5ffe13fe1cc tempest-VolumesSnapshotsTestJSON-977320371 None] snapshot_file for this snap is: volume-68a73b00-e4b3-4b42-9640-30c41391f03a.62e7cff8-f2a8-4ff3-b419-6e2875ecc0a2 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:32:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-12615cf0-c98b-469b-b535-63caa325c4c9 tempest-VolumesDeleteCascade-1219762349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320" returned: 0 in 0.946s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-12615cf0-c98b-469b-b535-63caa325c4c9 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320.0fc7e772-7df9-4a3e-bf30-4e316aa3f517 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:27 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9fbf11-f936-4fef-9b87-b10904aa9dd2]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:32:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-0c14980a-2302-43a6-a2f9-ebb997df93d1 req-ffbae5fd-21e3-4e0c-999e-f5ffe13fe1cc tempest-VolumesSnapshotsTestJSON-977320371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a.62e7cff8-f2a8-4ff3-b419-6e2875ecc0a2 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:27 devstack sudo[92373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320.0fc7e772-7df9-4a3e-bf30-4e316aa3f517 1G Nov 02 15:32:27 devstack sudo[92373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:27 devstack sudo[92376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a.62e7cff8-f2a8-4ff3-b419-6e2875ecc0a2 Nov 02 15:32:27 devstack sudo[92376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:28 devstack sudo[92373]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-12615cf0-c98b-469b-b535-63caa325c4c9 tempest-VolumesDeleteCascade-1219762349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320.0fc7e772-7df9-4a3e-bf30-4e316aa3f517 1G" returned: 0 in 0.712s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-12615cf0-c98b-469b-b535-63caa325c4c9 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320.0fc7e772-7df9-4a3e-bf30-4e316aa3f517 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:28 devstack sudo[92395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320.0fc7e772-7df9-4a3e-bf30-4e316aa3f517 Nov 02 15:32:28 devstack sudo[92395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:28 devstack sudo[92376]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-0c14980a-2302-43a6-a2f9-ebb997df93d1 req-ffbae5fd-21e3-4e0c-999e-f5ffe13fe1cc tempest-VolumesSnapshotsTestJSON-977320371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a.62e7cff8-f2a8-4ff3-b419-6e2875ecc0a2" returned: 0 in 0.792s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [req-0c14980a-2302-43a6-a2f9-ebb997df93d1 req-ffbae5fd-21e3-4e0c-999e-f5ffe13fe1cc tempest-VolumesSnapshotsTestJSON-977320371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68a73b00-e4b3-4b42-9640-30c41391f03a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:32:28 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb350267-14f4-4a70-8431-18d8ec364c5e]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:32:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-0c14980a-2302-43a6-a2f9-ebb997df93d1 req-ffbae5fd-21e3-4e0c-999e-f5ffe13fe1cc tempest-VolumesSnapshotsTestJSON-977320371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:28 devstack sudo[92397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a Nov 02 15:32:28 devstack sudo[92397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:28 devstack sudo[92395]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-12615cf0-c98b-469b-b535-63caa325c4c9 tempest-VolumesDeleteCascade-1219762349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320.0fc7e772-7df9-4a3e-bf30-4e316aa3f517" returned: 0 in 0.451s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:28 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-12615cf0-c98b-469b-b535-63caa325c4c9 tempest-VolumesDeleteCascade-1219762349 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320.0fc7e772-7df9-4a3e-bf30-4e316aa3f517 is being set with open permissions: ugo+rw Nov 02 15:32:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-12615cf0-c98b-469b-b535-63caa325c4c9 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320.0fc7e772-7df9-4a3e-bf30-4e316aa3f517 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:28 devstack sudo[92403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320.0fc7e772-7df9-4a3e-bf30-4e316aa3f517 Nov 02 15:32:28 devstack sudo[92403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:28 devstack sudo[92403]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-12615cf0-c98b-469b-b535-63caa325c4c9 tempest-VolumesDeleteCascade-1219762349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320.0fc7e772-7df9-4a3e-bf30-4e316aa3f517" returned: 0 in 0.346s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:28 devstack sudo[92397]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-0c14980a-2302-43a6-a2f9-ebb997df93d1 req-ffbae5fd-21e3-4e0c-999e-f5ffe13fe1cc tempest-VolumesSnapshotsTestJSON-977320371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a" returned: 0 in 0.724s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-0c14980a-2302-43a6-a2f9-ebb997df93d1 req-ffbae5fd-21e3-4e0c-999e-f5ffe13fe1cc tempest-VolumesSnapshotsTestJSON-977320371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a.62e7cff8-f2a8-4ff3-b419-6e2875ecc0a2 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-12615cf0-c98b-469b-b535-63caa325c4c9 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:28 devstack sudo[92426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a.62e7cff8-f2a8-4ff3-b419-6e2875ecc0a2 Nov 02 15:32:28 devstack sudo[92426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:29 devstack sudo[92430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320.info Nov 02 15:32:29 devstack sudo[92430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:29 devstack sudo[92430]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-12615cf0-c98b-469b-b535-63caa325c4c9 tempest-VolumesDeleteCascade-1219762349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320.info" returned: 0 in 0.560s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:29 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-12615cf0-c98b-469b-b535-63caa325c4c9 tempest-VolumesDeleteCascade-1219762349 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320.info is being set with open permissions: ugo+rw Nov 02 15:32:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-12615cf0-c98b-469b-b535-63caa325c4c9 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:29 devstack sudo[92426]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-0c14980a-2302-43a6-a2f9-ebb997df93d1 req-ffbae5fd-21e3-4e0c-999e-f5ffe13fe1cc tempest-VolumesSnapshotsTestJSON-977320371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a.62e7cff8-f2a8-4ff3-b419-6e2875ecc0a2" returned: 0 in 0.706s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-0c14980a-2302-43a6-a2f9-ebb997df93d1 req-ffbae5fd-21e3-4e0c-999e-f5ffe13fe1cc tempest-VolumesSnapshotsTestJSON-977320371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a.62e7cff8-f2a8-4ff3-b419-6e2875ecc0a2 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:29 devstack sudo[92442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320.info Nov 02 15:32:29 devstack sudo[92442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:29 devstack sudo[92448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a.62e7cff8-f2a8-4ff3-b419-6e2875ecc0a2 Nov 02 15:32:29 devstack sudo[92448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-b93cfef6-f92d-4421-8c5e-15f21ea2d700 req-efdce3ab-b0d0-4717-aebb-f344ffe47c39 tempest-ServerActionsTestOtherA-1672913331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:32:30 devstack sudo[92442]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-12615cf0-c98b-469b-b535-63caa325c4c9 tempest-VolumesDeleteCascade-1219762349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320.info" returned: 0 in 0.562s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-12615cf0-c98b-469b-b535-63caa325c4c9 tempest-VolumesDeleteCascade-1219762349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.923s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:32:30 devstack sudo[92448]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-b93cfef6-f92d-4421-8c5e-15f21ea2d700 req-efdce3ab-b0d0-4717-aebb-f344ffe47c39 tempest-ServerActionsTestOtherA-1672913331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.110s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:32:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-0c14980a-2302-43a6-a2f9-ebb997df93d1 req-ffbae5fd-21e3-4e0c-999e-f5ffe13fe1cc tempest-VolumesSnapshotsTestJSON-977320371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a.62e7cff8-f2a8-4ff3-b419-6e2875ecc0a2" returned: 0 in 0.519s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-b93cfef6-f92d-4421-8c5e-15f21ea2d700 req-efdce3ab-b0d0-4717-aebb-f344ffe47c39 tempest-ServerActionsTestOtherA-1672913331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.067s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:32:30 devstack cinder-volume[86703]: DEBUG cinder.coordination [req-0c14980a-2302-43a6-a2f9-ebb997df93d1 req-ffbae5fd-21e3-4e0c-999e-f5ffe13fe1cc tempest-VolumesSnapshotsTestJSON-977320371 None] Lock "cinder-quobyte-62e7cff8-f2a8-4ff3-b419-6e2875ecc0a2" released by "_delete_snapshot" :: held 2.945s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:32:30 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-12615cf0-c98b-469b-b535-63caa325c4c9 tempest-VolumesDeleteCascade-1219762349 None] Create snapshot completed successfully Nov 02 15:32:30 devstack cinder-volume[86703]: DEBUG cinder.coordination [req-0c14980a-2302-43a6-a2f9-ebb997df93d1 req-ffbae5fd-21e3-4e0c-999e-f5ffe13fe1cc tempest-VolumesSnapshotsTestJSON-977320371 None] Lock "cinder-quobyte-68a73b00-e4b3-4b42-9640-30c41391f03a" released by "delete_snapshot" :: held 2.993s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:32:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-b93cfef6-f92d-4421-8c5e-15f21ea2d700 req-efdce3ab-b0d0-4717-aebb-f344ffe47c39 tempest-ServerActionsTestOtherA-1672913331 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478', 'name': 'volume-e447838d-a9bf-49af-84b7-a7f2e65c9a5d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '472c2320-473a-452b-8820-682b8b7d9bf1', 'enforce_multipath': True} {{(pid=86703) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 15:32:30 devstack cinder-volume[86703]: DEBUG cinder.quota [req-0c14980a-2302-43a6-a2f9-ebb997df93d1 req-ffbae5fd-21e3-4e0c-999e-f5ffe13fe1cc tempest-VolumesSnapshotsTestJSON-977320371 None] Created reservations ['ae55cc5f-4658-47e4-9951-c2cdb77486fd', '4c82a437-b52f-4078-8415-a147e902a60c', '180b35aa-1440-4fef-a8b8-90dfda3c900c', '302af610-d082-42c7-8a4b-c2f68905075f'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:32:30 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-b93cfef6-f92d-4421-8c5e-15f21ea2d700 req-efdce3ab-b0d0-4717-aebb-f344ffe47c39 tempest-ServerActionsTestOtherA-1672913331 None] attachment_update completed successfully. Nov 02 15:32:30 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-0c14980a-2302-43a6-a2f9-ebb997df93d1 req-ffbae5fd-21e3-4e0c-999e-f5ffe13fe1cc tempest-VolumesSnapshotsTestJSON-977320371 None] Delete snapshot completed successfully. Nov 02 15:32:30 devstack cinder-volume[86703]: DEBUG cinder.coordination [req-0c14980a-2302-43a6-a2f9-ebb997df93d1 req-ffbae5fd-21e3-4e0c-999e-f5ffe13fe1cc tempest-VolumesSnapshotsTestJSON-977320371 None] Lock "cinder-62e7cff8-f2a8-4ff3-b419-6e2875ecc0a2-delete_snapshot" released by "delete_snapshot" :: held 3.568s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:32:31 devstack cinder-volume[86703]: DEBUG cinder.coordination [req-ef33c8cd-f0c9-4b22-b0ff-e23a6645eb58 req-c111d095-8d4e-4dfc-a25a-dcdbc6aec953 tempest-VolumesSnapshotsTestJSON-977320371 None] Acquiring lock "cinder-68a73b00-e4b3-4b42-9640-30c41391f03a-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:32:31 devstack cinder-volume[86703]: DEBUG cinder.coordination [req-ef33c8cd-f0c9-4b22-b0ff-e23a6645eb58 req-c111d095-8d4e-4dfc-a25a-dcdbc6aec953 tempest-VolumesSnapshotsTestJSON-977320371 None] Lock "cinder-68a73b00-e4b3-4b42-9640-30c41391f03a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:32:31 devstack cinder-volume[86703]: DEBUG cinder.coordination [req-ef33c8cd-f0c9-4b22-b0ff-e23a6645eb58 req-c111d095-8d4e-4dfc-a25a-dcdbc6aec953 tempest-VolumesSnapshotsTestJSON-977320371 None] Acquiring lock "cinder-quobyte-68a73b00-e4b3-4b42-9640-30c41391f03a" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:32:31 devstack cinder-volume[86703]: DEBUG cinder.coordination [req-ef33c8cd-f0c9-4b22-b0ff-e23a6645eb58 req-c111d095-8d4e-4dfc-a25a-dcdbc6aec953 tempest-VolumesSnapshotsTestJSON-977320371 None] Lock "cinder-quobyte-68a73b00-e4b3-4b42-9640-30c41391f03a" acquired by "delete_volume" :: waited 0.074s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:32:31 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4824e4f4-f57e-4d14-94e2-e2ac8bd99026]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:32:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-ef33c8cd-f0c9-4b22-b0ff-e23a6645eb58 req-c111d095-8d4e-4dfc-a25a-dcdbc6aec953 tempest-VolumesSnapshotsTestJSON-977320371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:31 devstack sudo[92456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a Nov 02 15:32:31 devstack sudo[92456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:32 devstack sudo[92456]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-ef33c8cd-f0c9-4b22-b0ff-e23a6645eb58 req-c111d095-8d4e-4dfc-a25a-dcdbc6aec953 tempest-VolumesSnapshotsTestJSON-977320371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a" returned: 0 in 0.942s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-ef33c8cd-f0c9-4b22-b0ff-e23a6645eb58 req-c111d095-8d4e-4dfc-a25a-dcdbc6aec953 tempest-VolumesSnapshotsTestJSON-977320371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:32 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:32:32 devstack sudo[92461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a Nov 02 15:32:32 devstack sudo[92461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Flow 'volume_create_manager' (efcbb04e-a4be-4c14-ae3f-54eb16185c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:32:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ddc6fdd-1d67-429c-a718-0c4516a7a2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ddc6fdd-1d67-429c-a718-0c4516a7a2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1062119544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4232dbc-16d2-4697-869b-c7b70feaef70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fec202c2de54ba790f44c99e0a28493',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:32:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0fc7e772-7df9-4a3e-bf30-4e316aa3f517,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:32:32Z,use_quota=True,user_id='8350f6dc69a24e90aceda39ce7809e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0706cf9-09b2-49cd-9db8-179a2160347f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0706cf9-09b2-49cd-9db8-179a2160347f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7cd9a76-e624-47e1-9c17-50bf3010c72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7cd9a76-e624-47e1-9c17-50bf3010c72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a4232dbc-16d2-4697-869b-c7b70feaef70', 'volume_name': 'volume-a4232dbc-16d2-4697-869b-c7b70feaef70', 'volume_size': 1, 'snapshot_id': '0fc7e772-7df9-4a3e-bf30-4e316aa3f517'}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c88968b-182c-458a-819f-52ce7e9a8ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c88968b-182c-458a-819f-52ce7e9a8ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd14c63b-917f-4819-9b97-e167ad86f1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:32 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Volume a4232dbc-16d2-4697-869b-c7b70feaef70: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a4232dbc-16d2-4697-869b-c7b70feaef70', 'volume_size': 1, 'snapshot_id': '0fc7e772-7df9-4a3e-bf30-4e316aa3f517'} Nov 02 15:32:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:32:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:32:32 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Acquiring lock "cinder-quobyte-0fc7e772-7df9-4a3e-bf30-4e316aa3f517-a4232dbc-16d2-4697-869b-c7b70feaef70" by "_create_volume_from_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:32:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-quobyte-0fc7e772-7df9-4a3e-bf30-4e316aa3f517-a4232dbc-16d2-4697-869b-c7b70feaef70" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:32:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Creating volume a4232dbc-16d2-4697-869b-c7b70feaef70 from snapshot 0fc7e772-7df9-4a3e-bf30-4e316aa3f517 {{(pid=86703) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 15:32:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:32:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:32:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:32:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:32:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:32:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:32:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Acquiring lock "cinder-quobyte-a4232dbc-16d2-4697-869b-c7b70feaef70" by "_copy_volume_from_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:32:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-quobyte-a4232dbc-16d2-4697-869b-c7b70feaef70" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:32:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] snapshot: 0fc7e772-7df9-4a3e-bf30-4e316aa3f517, volume: a4232dbc-16d2-4697-869b-c7b70feaef70, {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 15:32:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:32:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:32:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:32:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:32:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:32:33 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ee8a13-d73b-431c-a8e2-a0e403b6ea5f]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:32:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320.0fc7e772-7df9-4a3e-bf30-4e316aa3f517 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:33 devstack sudo[92461]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-ef33c8cd-f0c9-4b22-b0ff-e23a6645eb58 req-c111d095-8d4e-4dfc-a25a-dcdbc6aec953 tempest-VolumesSnapshotsTestJSON-977320371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68a73b00-e4b3-4b42-9640-30c41391f03a" returned: 0 in 0.703s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [req-ef33c8cd-f0c9-4b22-b0ff-e23a6645eb58 req-c111d095-8d4e-4dfc-a25a-dcdbc6aec953 tempest-VolumesSnapshotsTestJSON-977320371 None] Lock "cinder-quobyte-68a73b00-e4b3-4b42-9640-30c41391f03a" released by "delete_volume" :: held 1.855s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:32:33 devstack sudo[92463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320.0fc7e772-7df9-4a3e-bf30-4e316aa3f517 Nov 02 15:32:33 devstack sudo[92463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:33 devstack cinder-volume[86703]: DEBUG cinder.quota [req-ef33c8cd-f0c9-4b22-b0ff-e23a6645eb58 req-c111d095-8d4e-4dfc-a25a-dcdbc6aec953 tempest-VolumesSnapshotsTestJSON-977320371 None] Created reservations ['4bda14fa-3eb8-4466-9c0d-3e49d3fed0b0', 'bbf4dc38-d2bc-45e9-8968-8cd95c6055d6', '2ac1cd82-0f77-4932-85a7-ce7e06763224', '025cb917-d881-44bf-a668-8ab312eb2698'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:32:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-ef33c8cd-f0c9-4b22-b0ff-e23a6645eb58 req-c111d095-8d4e-4dfc-a25a-dcdbc6aec953 tempest-VolumesSnapshotsTestJSON-977320371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:32:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-ef33c8cd-f0c9-4b22-b0ff-e23a6645eb58 req-c111d095-8d4e-4dfc-a25a-dcdbc6aec953 tempest-VolumesSnapshotsTestJSON-977320371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:32:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [req-ef33c8cd-f0c9-4b22-b0ff-e23a6645eb58 req-c111d095-8d4e-4dfc-a25a-dcdbc6aec953 tempest-VolumesSnapshotsTestJSON-977320371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:32:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [req-ef33c8cd-f0c9-4b22-b0ff-e23a6645eb58 req-c111d095-8d4e-4dfc-a25a-dcdbc6aec953 tempest-VolumesSnapshotsTestJSON-977320371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:32:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-ef33c8cd-f0c9-4b22-b0ff-e23a6645eb58 req-c111d095-8d4e-4dfc-a25a-dcdbc6aec953 tempest-VolumesSnapshotsTestJSON-977320371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:32:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-ef33c8cd-f0c9-4b22-b0ff-e23a6645eb58 req-c111d095-8d4e-4dfc-a25a-dcdbc6aec953 tempest-VolumesSnapshotsTestJSON-977320371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:33 devstack sudo[92469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:32:33 devstack sudo[92469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:33 devstack sudo[92463]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320.0fc7e772-7df9-4a3e-bf30-4e316aa3f517" returned: 0 in 0.819s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:32:33 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a06eda-e9b5-4b29-8416-6a9617e457d9]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:32:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:34 devstack sudo[92469]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-ef33c8cd-f0c9-4b22-b0ff-e23a6645eb58 req-c111d095-8d4e-4dfc-a25a-dcdbc6aec953 tempest-VolumesSnapshotsTestJSON-977320371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.540s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:34 devstack cinder-volume[86703]: DEBUG cinder.manager [req-ef33c8cd-f0c9-4b22-b0ff-e23a6645eb58 req-c111d095-8d4e-4dfc-a25a-dcdbc6aec953 tempest-VolumesSnapshotsTestJSON-977320371 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:32:34 devstack sudo[92473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320 Nov 02 15:32:34 devstack sudo[92473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:34 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-ef33c8cd-f0c9-4b22-b0ff-e23a6645eb58 req-c111d095-8d4e-4dfc-a25a-dcdbc6aec953 tempest-VolumesSnapshotsTestJSON-977320371 None] Deleted volume successfully. Nov 02 15:32:34 devstack cinder-volume[86703]: DEBUG cinder.coordination [req-ef33c8cd-f0c9-4b22-b0ff-e23a6645eb58 req-c111d095-8d4e-4dfc-a25a-dcdbc6aec953 tempest-VolumesSnapshotsTestJSON-977320371 None] Lock "cinder-68a73b00-e4b3-4b42-9640-30c41391f03a-delete_volume" released by "delete_volume" :: held 3.089s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:32:34 devstack sudo[92473]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320" returned: 0 in 0.755s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:34 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] will copy from snapshot at /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320 {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 15:32:34 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Creating direct copy from snapshot {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 15:32:34 devstack cinder-volume[86703]: DEBUG cinder.utils [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Path /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4232dbc-16d2-4697-869b-c7b70feaef70 not found in is_blk_device check {{(pid=86703) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 15:32:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4232dbc-16d2-4697-869b-c7b70feaef70 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:34 devstack sudo[92515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4232dbc-16d2-4697-869b-c7b70feaef70 Nov 02 15:32:34 devstack sudo[92515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:35 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:32:35 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] Flow 'volume_create_manager' (45f2e7e9-3639-461d-9428-237955f07256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:32:35 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edc3935d-ecdf-48ab-983f-2a96c8b75a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:35 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edc3935d-ecdf-48ab-983f-2a96c8b75a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-121195157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=983b965d-2499-4fbb-8df5-e7c54cdde823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbfca910d1e7419899aced47da3f4c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:32:36Z,use_quota=True,user_id='0567cdb20e5f487f8fde9689f11eb0f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:35 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (538c202e-3dab-43e1-ae76-fed5e8b4863a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:35 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (538c202e-3dab-43e1-ae76-fed5e8b4863a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:35 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2848d405-a9ca-40dd-afab-c0581fe6618c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:35 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2848d405-a9ca-40dd-afab-c0581fe6618c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '983b965d-2499-4fbb-8df5-e7c54cdde823', 'volume_name': 'volume-983b965d-2499-4fbb-8df5-e7c54cdde823', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:35 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80a28b87-aaae-40bb-8560-c8b69348714b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:35 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80a28b87-aaae-40bb-8560-c8b69348714b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:35 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15e1dc1c-f7f8-462d-b11d-ca9cf6328ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:35 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] Volume 983b965d-2499-4fbb-8df5-e7c54cdde823: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-983b965d-2499-4fbb-8df5-e7c54cdde823', 'volume_size': 1} Nov 02 15:32:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:32:45 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=44,cinder:UPDATE=43,cinder:INSERT=15,cinder:DELETE=4 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:32:45 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:UPDATE=48,cinder:SELECT=54,cinder:INSERT=19,cinder:DELETE=3 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:32:49 devstack sudo[92515]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4232dbc-16d2-4697-869b-c7b70feaef70" returned: 0 in 14.365s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:49 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Image conversion details: src /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320, size 1024.00 MB, duration 14.37 sec, destination /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4232dbc-16d2-4697-869b-c7b70feaef70 {{(pid=86703) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 15:32:49 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Converted 1024.00 MB image at 71.28 MB/s Nov 02 15:32:49 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4232dbc-16d2-4697-869b-c7b70feaef70 is being set with open permissions: ugo+rw Nov 02 15:32:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4232dbc-16d2-4697-869b-c7b70feaef70 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:49 devstack sudo[93067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4232dbc-16d2-4697-869b-c7b70feaef70 Nov 02 15:32:49 devstack sudo[93067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:49 devstack sudo[93067]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4232dbc-16d2-4697-869b-c7b70feaef70" returned: 0 in 0.464s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:49 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-quobyte-a4232dbc-16d2-4697-869b-c7b70feaef70" released by "_copy_volume_from_snapshot" :: held 16.580s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:32:49 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-quobyte-0fc7e772-7df9-4a3e-bf30-4e316aa3f517-a4232dbc-16d2-4697-869b-c7b70feaef70" released by "_create_volume_from_snapshot" :: held 16.685s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:32:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 16.727s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:32:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.825s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:32:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-121195157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=983b965d-2499-4fbb-8df5-e7c54cdde823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbfca910d1e7419899aced47da3f4c1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:32:36Z,use_quota=True,user_id='0567cdb20e5f487f8fde9689f11eb0f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:32:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] Creating volume 983b965d-2499-4fbb-8df5-e7c54cdde823 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:32:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:32:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:32:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:32:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:32:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:32:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:32:49 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:32:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-983b965d-2499-4fbb-8df5-e7c54cdde823 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:49 devstack sudo[93070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-983b965d-2499-4fbb-8df5-e7c54cdde823 1073741824 Nov 02 15:32:49 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd14c63b-917f-4819-9b97-e167ad86f1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4232dbc-16d2-4697-869b-c7b70feaef70', 'volume_size': 1, 'snapshot_id': '0fc7e772-7df9-4a3e-bf30-4e316aa3f517'}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (160bb13a-4846-41a0-9aac-0237795752a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:49 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Volume volume-a4232dbc-16d2-4697-869b-c7b70feaef70 (a4232dbc-16d2-4697-869b-c7b70feaef70): created successfully Nov 02 15:32:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (160bb13a-4846-41a0-9aac-0237795752a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Flow 'volume_create_manager' (efcbb04e-a4be-4c14-ae3f-54eb16185c43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:32:50 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-694bca3f-f0c9-4511-b3a8-42424ebccf6f tempest-VolumesDeleteCascade-1219762349 None] Created volume successfully. Nov 02 15:32:50 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:32:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] Flow 'volume_create_manager' (010641f5-b9df-48e1-98ed-e5932b5fa49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:32:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc79c7b-5bbd-42d6-96b2-31cc3d4a013a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dc79c7b-5bbd-42d6-96b2-31cc3d4a013a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1845340955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9829dc7-7b0a-4f71-8967-568fa7adc3e4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4165b3203001462fbb4a38edce40b659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:32:50Z,use_quota=True,user_id='4e33f433519c46d88cd764bbddab900e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11100c68-b8c4-40a6-b83a-11c484567df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11100c68-b8c4-40a6-b83a-11c484567df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df4877cc-f4b6-4c90-a6ec-27be28727f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df4877cc-f4b6-4c90-a6ec-27be28727f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9829dc7-7b0a-4f71-8967-568fa7adc3e4', 'volume_name': 'volume-b9829dc7-7b0a-4f71-8967-568fa7adc3e4', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0aaa95a-5c04-4c3f-a887-77452ae6d9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0aaa95a-5c04-4c3f-a887-77452ae6d9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:50 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2fef5d4-062f-4f31-a991-d014b1abaf37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:50 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] Volume b9829dc7-7b0a-4f71-8967-568fa7adc3e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9829dc7-7b0a-4f71-8967-568fa7adc3e4', 'volume_size': 1} Nov 02 15:32:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:32:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-983b965d-2499-4fbb-8df5-e7c54cdde823 1073741824" returned: 0 in 0.741s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-983b965d-2499-4fbb-8df5-e7c54cdde823 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:50 devstack sudo[93076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-983b965d-2499-4fbb-8df5-e7c54cdde823 Nov 02 15:32:50 devstack sudo[93076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:50 devstack sudo[93076]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:50 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Acquiring lock "cinder-dd40b4ad-d4a7-4d34-a47d-7b933561d320-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:32:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-983b965d-2499-4fbb-8df5-e7c54cdde823" returned: 0 in 0.360s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:50 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:32:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:32:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.430s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:32:50 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1845340955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9829dc7-7b0a-4f71-8967-568fa7adc3e4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4165b3203001462fbb4a38edce40b659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:32:50Z,use_quota=True,user_id='4e33f433519c46d88cd764bbddab900e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:32:50 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] Creating volume b9829dc7-7b0a-4f71-8967-568fa7adc3e4 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:32:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:32:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:32:50 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:32:50 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:32:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:32:50 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:32:50 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:32:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b9829dc7-7b0a-4f71-8967-568fa7adc3e4 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15e1dc1c-f7f8-462d-b11d-ca9cf6328ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-983b965d-2499-4fbb-8df5-e7c54cdde823', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f59ca074-c13d-44eb-a270-38621eb90b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:50 devstack sudo[93079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b9829dc7-7b0a-4f71-8967-568fa7adc3e4 1073741824 Nov 02 15:32:50 devstack sudo[93079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:50 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-dd40b4ad-d4a7-4d34-a47d-7b933561d320-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:32:50 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] Volume volume-983b965d-2499-4fbb-8df5-e7c54cdde823 (983b965d-2499-4fbb-8df5-e7c54cdde823): created successfully Nov 02 15:32:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f59ca074-c13d-44eb-a270-38621eb90b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] Flow 'volume_create_manager' (45f2e7e9-3639-461d-9428-237955f07256) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:32:51 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-6f5d974f-7220-4204-8e2e-701d6301771d tempest-ServerRescueNegativeTestJSON-60814456 None] Created volume successfully. Nov 02 15:32:51 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Performing cascade delete. {{(pid=86703) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 02 15:32:51 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Acquiring lock "cinder-0fc7e772-7df9-4a3e-bf30-4e316aa3f517-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:32:51 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-0fc7e772-7df9-4a3e-bf30-4e316aa3f517-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:32:51 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Acquiring lock "cinder-quobyte-dd40b4ad-d4a7-4d34-a47d-7b933561d320" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:32:51 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-quobyte-dd40b4ad-d4a7-4d34-a47d-7b933561d320" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:32:51 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Acquiring lock "cinder-quobyte-0fc7e772-7df9-4a3e-bf30-4e316aa3f517" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:32:51 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-quobyte-0fc7e772-7df9-4a3e-bf30-4e316aa3f517" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:32:51 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Deleting offline snapshot 0fc7e772-7df9-4a3e-bf30-4e316aa3f517 of volume dd40b4ad-d4a7-4d34-a47d-7b933561d320 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:32:51 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] snapshot_file for this snap is: volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320.0fc7e772-7df9-4a3e-bf30-4e316aa3f517 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:32:51 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1750de20-1d92-4cdf-8bd2-de6f3135aeab]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:32:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320.0fc7e772-7df9-4a3e-bf30-4e316aa3f517 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:51 devstack sudo[93081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320.0fc7e772-7df9-4a3e-bf30-4e316aa3f517 Nov 02 15:32:51 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:51 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320.0fc7e772-7df9-4a3e-bf30-4e316aa3f517" returned: 0 in 0.551s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:51 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:32:51 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20f3d62-a239-467a-946d-7f8984dc8267]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:32:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:51 devstack sudo[93079]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b9829dc7-7b0a-4f71-8967-568fa7adc3e4 1073741824" returned: 0 in 1.000s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b9829dc7-7b0a-4f71-8967-568fa7adc3e4 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:52 devstack sudo[93090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b9829dc7-7b0a-4f71-8967-568fa7adc3e4 Nov 02 15:32:52 devstack sudo[93090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:52 devstack sudo[93089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320 Nov 02 15:32:52 devstack sudo[93089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:52 devstack sudo[93090]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b9829dc7-7b0a-4f71-8967-568fa7adc3e4" returned: 0 in 0.584s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:52 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:32:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:32:52 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2fef5d4-062f-4f31-a991-d014b1abaf37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9829dc7-7b0a-4f71-8967-568fa7adc3e4', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:52 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d245ce7b-489c-45c3-8fe7-aa82f763ab60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:52 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] Volume volume-b9829dc7-7b0a-4f71-8967-568fa7adc3e4 (b9829dc7-7b0a-4f71-8967-568fa7adc3e4): created successfully Nov 02 15:32:52 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d245ce7b-489c-45c3-8fe7-aa82f763ab60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:52 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] Flow 'volume_create_manager' (010641f5-b9df-48e1-98ed-e5932b5fa49e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:32:52 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-de32dabd-5625-41ab-a8aa-f95c28c4c01b tempest-VolumesTestJSON-426474820 None] Created volume successfully. Nov 02 15:32:52 devstack sudo[93089]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320" returned: 0 in 1.086s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320.0fc7e772-7df9-4a3e-bf30-4e316aa3f517 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:52 devstack sudo[93099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320.0fc7e772-7df9-4a3e-bf30-4e316aa3f517 Nov 02 15:32:52 devstack sudo[93099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:53 devstack sudo[93099]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320.0fc7e772-7df9-4a3e-bf30-4e316aa3f517" returned: 0 in 0.498s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320.0fc7e772-7df9-4a3e-bf30-4e316aa3f517 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:53 devstack sudo[93110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320.0fc7e772-7df9-4a3e-bf30-4e316aa3f517 Nov 02 15:32:53 devstack sudo[93110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:54 devstack sudo[93110]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320.0fc7e772-7df9-4a3e-bf30-4e316aa3f517" returned: 0 in 0.579s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:54 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-quobyte-0fc7e772-7df9-4a3e-bf30-4e316aa3f517" released by "_delete_snapshot" :: held 2.960s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:32:54 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-quobyte-dd40b4ad-d4a7-4d34-a47d-7b933561d320" released by "delete_snapshot" :: held 3.019s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:32:54 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Created reservations ['06df3cad-d6ec-42c1-8c24-6d72ae33902b', 'd424db5c-ce7c-44cd-bc3f-fcea3d98a2ff', 'e1ec5f19-6065-4f59-98e9-af07483bd4fe', 'f99203ef-4381-4449-9d79-1668ccf45dd1'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:32:54 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Delete snapshot completed successfully. Nov 02 15:32:54 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-0fc7e772-7df9-4a3e-bf30-4e316aa3f517-delete_snapshot" released by "delete_snapshot" :: held 3.415s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:32:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Snapshots deleted, issuing volume delete {{(pid=86703) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 02 15:32:54 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Acquiring lock "cinder-quobyte-dd40b4ad-d4a7-4d34-a47d-7b933561d320" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:32:54 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-quobyte-dd40b4ad-d4a7-4d34-a47d-7b933561d320" acquired by "delete_volume" :: waited 0.037s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:32:54 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c60b226-1c5c-4ba8-b5cf-3b2b2d38f114]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:32:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:54 devstack sudo[93119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320 Nov 02 15:32:54 devstack sudo[93119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:55 devstack sudo[93119]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320" returned: 0 in 1.213s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:55 devstack sudo[93172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320 Nov 02 15:32:55 devstack sudo[93172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:55 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:32:56 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] Flow 'volume_create_manager' (23f45c2e-0209-45b3-8ff7-63de1ee5e2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:32:56 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca425f03-ffdc-4168-8a4a-aa75b0c22172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:56 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca425f03-ffdc-4168-8a4a-aa75b0c22172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-10523554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=055eb7af-8d91-4adb-8bde-36afe69191fe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4165b3203001462fbb4a38edce40b659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:32:56Z,use_quota=True,user_id='4e33f433519c46d88cd764bbddab900e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:56 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093de2e8-29da-4d68-9307-3f966e1c7d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:56 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093de2e8-29da-4d68-9307-3f966e1c7d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:56 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd92e4b7-96c9-4fa4-a734-9ff23539db7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:56 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd92e4b7-96c9-4fa4-a734-9ff23539db7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '055eb7af-8d91-4adb-8bde-36afe69191fe', 'volume_name': 'volume-055eb7af-8d91-4adb-8bde-36afe69191fe', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:56 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8e1c5a-f423-4772-bcbf-ee371217bb50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:56 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8e1c5a-f423-4772-bcbf-ee371217bb50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:56 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae9b916-ee42-4020-a72b-daf69b235d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:56 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] Volume 055eb7af-8d91-4adb-8bde-36afe69191fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-055eb7af-8d91-4adb-8bde-36afe69191fe', 'volume_size': 1} Nov 02 15:32:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:32:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:32:56 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:32:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-10523554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=055eb7af-8d91-4adb-8bde-36afe69191fe,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4165b3203001462fbb4a38edce40b659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:32:56Z,use_quota=True,user_id='4e33f433519c46d88cd764bbddab900e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:32:56 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] Creating volume 055eb7af-8d91-4adb-8bde-36afe69191fe {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:32:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:32:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:32:56 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:32:56 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:32:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:32:56 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:32:56 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:32:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-055eb7af-8d91-4adb-8bde-36afe69191fe 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:56 devstack sudo[93174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-055eb7af-8d91-4adb-8bde-36afe69191fe 1073741824 Nov 02 15:32:56 devstack sudo[93174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:56 devstack sudo[93172]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-dd40b4ad-d4a7-4d34-a47d-7b933561d320" returned: 0 in 0.567s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:56 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-quobyte-dd40b4ad-d4a7-4d34-a47d-7b933561d320" released by "delete_volume" :: held 1.928s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:32:56 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Created reservations ['8375e7da-5447-4d2f-a273-13ec1017510c', '66b5da19-bdd8-4787-854e-c97c1ccf4c65', '5f9ed68a-32db-43e0-9ded-547b3990b9c3', 'd2eee654-af0b-48d5-9f5f-c149726ff4e8'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:32:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:32:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:32:56 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:32:56 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:32:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:32:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:56 devstack sudo[93181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:32:56 devstack sudo[93181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:57 devstack sudo[93174]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-055eb7af-8d91-4adb-8bde-36afe69191fe 1073741824" returned: 0 in 0.775s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-055eb7af-8d91-4adb-8bde-36afe69191fe {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:57 devstack sudo[93183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-055eb7af-8d91-4adb-8bde-36afe69191fe Nov 02 15:32:57 devstack sudo[93183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:57 devstack sudo[93181]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.351s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:57 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:32:57 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Deleted volume successfully. Nov 02 15:32:57 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0059df0b-88dc-4c36-a197-6322a3583a73 tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-dd40b4ad-d4a7-4d34-a47d-7b933561d320-delete_volume" released by "delete_volume" :: held 6.324s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:32:57 devstack sudo[93183]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-055eb7af-8d91-4adb-8bde-36afe69191fe" returned: 0 in 0.800s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:32:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:32:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ae9b916-ee42-4020-a72b-daf69b235d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-055eb7af-8d91-4adb-8bde-36afe69191fe', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (522f5478-36fa-425e-9298-0abe12c396c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:32:58 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] Volume volume-055eb7af-8d91-4adb-8bde-36afe69191fe (055eb7af-8d91-4adb-8bde-36afe69191fe): created successfully Nov 02 15:32:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (522f5478-36fa-425e-9298-0abe12c396c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:32:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] Flow 'volume_create_manager' (23f45c2e-0209-45b3-8ff7-63de1ee5e2fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:32:58 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-7a30f5c1-d9c2-4bde-84da-c15fc325a878 tempest-VolumesTestJSON-426474820 None] Created volume successfully. Nov 02 15:32:58 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-41c98e3a-6d84-4089-9cce-093d2a932f1f tempest-VolumesDeleteCascade-1219762349 None] Acquiring lock "cinder-a4232dbc-16d2-4697-869b-c7b70feaef70-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:32:58 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-41c98e3a-6d84-4089-9cce-093d2a932f1f tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-a4232dbc-16d2-4697-869b-c7b70feaef70-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:32:58 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-d2690854-04c9-451b-8912-84f4b6d0f6b4 req-d7d0056d-8243-4e25-b3ff-788604f6f0c8 tempest-ServerActionsTestOtherA-1672913331 None] Terminate volume connection completed successfully. Nov 02 15:32:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-d2690854-04c9-451b-8912-84f4b6d0f6b4 req-d7d0056d-8243-4e25-b3ff-788604f6f0c8 tempest-ServerActionsTestOtherA-1672913331 None] Deleting attachment 472c2320-473a-452b-8820-682b8b7d9bf1. {{(pid=86703) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 15:32:58 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-41c98e3a-6d84-4089-9cce-093d2a932f1f tempest-VolumesDeleteCascade-1219762349 None] Acquiring lock "cinder-quobyte-a4232dbc-16d2-4697-869b-c7b70feaef70" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:32:58 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-41c98e3a-6d84-4089-9cce-093d2a932f1f tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-quobyte-a4232dbc-16d2-4697-869b-c7b70feaef70" acquired by "delete_volume" :: waited 0.040s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:32:58 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c367cc8d-1b62-492b-be36-999c7eefdbe7]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:32:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-41c98e3a-6d84-4089-9cce-093d2a932f1f tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4232dbc-16d2-4697-869b-c7b70feaef70 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:58 devstack sudo[93211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4232dbc-16d2-4697-869b-c7b70feaef70 Nov 02 15:32:58 devstack sudo[93211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:59 devstack sudo[93211]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-41c98e3a-6d84-4089-9cce-093d2a932f1f tempest-VolumesDeleteCascade-1219762349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4232dbc-16d2-4697-869b-c7b70feaef70" returned: 0 in 0.564s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-41c98e3a-6d84-4089-9cce-093d2a932f1f tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4232dbc-16d2-4697-869b-c7b70feaef70 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:59 devstack sudo[93217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4232dbc-16d2-4697-869b-c7b70feaef70 Nov 02 15:32:59 devstack sudo[93217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:32:59 devstack sudo[93217]: pam_unix(sudo:session): session closed for user root Nov 02 15:32:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-41c98e3a-6d84-4089-9cce-093d2a932f1f tempest-VolumesDeleteCascade-1219762349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4232dbc-16d2-4697-869b-c7b70feaef70" returned: 0 in 0.367s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:32:59 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-41c98e3a-6d84-4089-9cce-093d2a932f1f tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-quobyte-a4232dbc-16d2-4697-869b-c7b70feaef70" released by "delete_volume" :: held 1.029s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:32:59 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-41c98e3a-6d84-4089-9cce-093d2a932f1f tempest-VolumesDeleteCascade-1219762349 None] Created reservations ['60b45fbd-0c88-4207-b142-7fa8adfd0fcb', 'f9af5d26-48ef-4479-98ff-42ce0ac7fd37', '9e3fe394-cf4c-4ab4-b349-a11768230a0b', '9122dcf1-9e5f-4e9f-b041-6dab94e5133f'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:32:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-41c98e3a-6d84-4089-9cce-093d2a932f1f tempest-VolumesDeleteCascade-1219762349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:32:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-41c98e3a-6d84-4089-9cce-093d2a932f1f tempest-VolumesDeleteCascade-1219762349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:32:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-41c98e3a-6d84-4089-9cce-093d2a932f1f tempest-VolumesDeleteCascade-1219762349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:32:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-41c98e3a-6d84-4089-9cce-093d2a932f1f tempest-VolumesDeleteCascade-1219762349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:32:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-41c98e3a-6d84-4089-9cce-093d2a932f1f tempest-VolumesDeleteCascade-1219762349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:32:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-41c98e3a-6d84-4089-9cce-093d2a932f1f tempest-VolumesDeleteCascade-1219762349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:32:59 devstack sudo[93220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:32:59 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:00 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-41c98e3a-6d84-4089-9cce-093d2a932f1f tempest-VolumesDeleteCascade-1219762349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.498s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:00 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-41c98e3a-6d84-4089-9cce-093d2a932f1f tempest-VolumesDeleteCascade-1219762349 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:33:00 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-41c98e3a-6d84-4089-9cce-093d2a932f1f tempest-VolumesDeleteCascade-1219762349 None] Deleted volume successfully. Nov 02 15:33:00 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:33:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] Flow 'volume_create_manager' (2e831dc6-dd85-40f4-a27b-a7c7cfb6563f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:33:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b40999-0bcf-44ee-a823-d00323068b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b40999-0bcf-44ee-a823-d00323068b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1913205076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b839fbc-ad94-49a1-a6e7-07b54c76b3b4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4165b3203001462fbb4a38edce40b659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:33:00Z,use_quota=True,user_id='4e33f433519c46d88cd764bbddab900e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d233c06-1913-4041-9468-8f06a3a3962a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d233c06-1913-4041-9468-8f06a3a3962a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a49cb243-1d06-43aa-957b-d64cc91c9a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a49cb243-1d06-43aa-957b-d64cc91c9a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b839fbc-ad94-49a1-a6e7-07b54c76b3b4', 'volume_name': 'volume-7b839fbc-ad94-49a1-a6e7-07b54c76b3b4', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af1b7d2d-a547-4bac-b6e9-5344b4a588e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af1b7d2d-a547-4bac-b6e9-5344b4a588e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f587ea9d-dcac-408c-bb6d-66568fcbd6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:00 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] Volume 7b839fbc-ad94-49a1-a6e7-07b54c76b3b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b839fbc-ad94-49a1-a6e7-07b54c76b3b4', 'volume_size': 1} Nov 02 15:33:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:33:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:33:00 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1913205076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b839fbc-ad94-49a1-a6e7-07b54c76b3b4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4165b3203001462fbb4a38edce40b659',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:33:00Z,use_quota=True,user_id='4e33f433519c46d88cd764bbddab900e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:33:00 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] Creating volume 7b839fbc-ad94-49a1-a6e7-07b54c76b3b4 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:33:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:33:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:33:00 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:33:00 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:33:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:33:00 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:33:00 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:33:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7b839fbc-ad94-49a1-a6e7-07b54c76b3b4 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:00 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-41c98e3a-6d84-4089-9cce-093d2a932f1f tempest-VolumesDeleteCascade-1219762349 None] Lock "cinder-a4232dbc-16d2-4697-869b-c7b70feaef70-delete_volume" released by "delete_volume" :: held 2.085s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:33:00 devstack sudo[93223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7b839fbc-ad94-49a1-a6e7-07b54c76b3b4 1073741824 Nov 02 15:33:00 devstack sudo[93223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-d2690854-04c9-451b-8912-84f4b6d0f6b4 req-fb88a6f9-ef3b-4dad-bbb4-05ac761d8166 tempest-ServerActionsTestOtherA-1672913331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:33:01 devstack sudo[93223]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7b839fbc-ad94-49a1-a6e7-07b54c76b3b4 1073741824" returned: 0 in 1.066s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7b839fbc-ad94-49a1-a6e7-07b54c76b3b4 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:01 devstack sudo[93237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7b839fbc-ad94-49a1-a6e7-07b54c76b3b4 Nov 02 15:33:01 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:01 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7b839fbc-ad94-49a1-a6e7-07b54c76b3b4" returned: 0 in 0.316s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:01 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:33:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:33:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-d2690854-04c9-451b-8912-84f4b6d0f6b4 req-fb88a6f9-ef3b-4dad-bbb4-05ac761d8166 tempest-ServerActionsTestOtherA-1672913331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.522s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:33:01 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f587ea9d-dcac-408c-bb6d-66568fcbd6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b839fbc-ad94-49a1-a6e7-07b54c76b3b4', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:01 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b3320a-22ca-4680-98aa-fd6b18ae4c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-d2690854-04c9-451b-8912-84f4b6d0f6b4 req-fb88a6f9-ef3b-4dad-bbb4-05ac761d8166 tempest-ServerActionsTestOtherA-1672913331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:33:01 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] Volume volume-7b839fbc-ad94-49a1-a6e7-07b54c76b3b4 (7b839fbc-ad94-49a1-a6e7-07b54c76b3b4): created successfully Nov 02 15:33:01 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36b3320a-22ca-4680-98aa-fd6b18ae4c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:01 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] Flow 'volume_create_manager' (2e831dc6-dd85-40f4-a27b-a7c7cfb6563f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:33:01 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-d2690854-04c9-451b-8912-84f4b6d0f6b4 req-fb88a6f9-ef3b-4dad-bbb4-05ac761d8166 tempest-ServerActionsTestOtherA-1672913331 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478', 'name': 'volume-e447838d-a9bf-49af-84b7-a7f2e65c9a5d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3756e51b-f0f3-40cb-ba04-0818debfada1', 'enforce_multipath': True} {{(pid=86703) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 15:33:01 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-d789a454-46e3-441c-b631-46f154fd387e tempest-VolumesTestJSON-426474820 None] Created volume successfully. Nov 02 15:33:02 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-d2690854-04c9-451b-8912-84f4b6d0f6b4 req-fb88a6f9-ef3b-4dad-bbb4-05ac761d8166 tempest-ServerActionsTestOtherA-1672913331 None] attachment_update completed successfully. Nov 02 15:33:05 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-bab43b54-6aea-4eef-b947-78c793d16786 tempest-VolumesTestJSON-426474820 None] Acquiring lock "cinder-7b839fbc-ad94-49a1-a6e7-07b54c76b3b4-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:33:05 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-bab43b54-6aea-4eef-b947-78c793d16786 tempest-VolumesTestJSON-426474820 None] Lock "cinder-7b839fbc-ad94-49a1-a6e7-07b54c76b3b4-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:33:05 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-bab43b54-6aea-4eef-b947-78c793d16786 tempest-VolumesTestJSON-426474820 None] Acquiring lock "cinder-quobyte-7b839fbc-ad94-49a1-a6e7-07b54c76b3b4" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:33:05 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-bab43b54-6aea-4eef-b947-78c793d16786 tempest-VolumesTestJSON-426474820 None] Lock "cinder-quobyte-7b839fbc-ad94-49a1-a6e7-07b54c76b3b4" acquired by "delete_volume" :: waited 0.043s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:33:05 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e840090e-f8f9-43e9-b174-d13fbc8e106d]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:33:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bab43b54-6aea-4eef-b947-78c793d16786 tempest-VolumesTestJSON-426474820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7b839fbc-ad94-49a1-a6e7-07b54c76b3b4 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:05 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-dd491d82-7e27-47b8-a9a7-563350ae1232 tempest-ServerRescueNegativeTestJSON-60814456 None] Acquiring lock "cinder-983b965d-2499-4fbb-8df5-e7c54cdde823-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:33:05 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-dd491d82-7e27-47b8-a9a7-563350ae1232 tempest-ServerRescueNegativeTestJSON-60814456 None] Lock "cinder-983b965d-2499-4fbb-8df5-e7c54cdde823-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:33:05 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-dd491d82-7e27-47b8-a9a7-563350ae1232 tempest-ServerRescueNegativeTestJSON-60814456 None] Acquiring lock "cinder-quobyte-983b965d-2499-4fbb-8df5-e7c54cdde823" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:33:05 devstack sudo[93754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7b839fbc-ad94-49a1-a6e7-07b54c76b3b4 Nov 02 15:33:05 devstack sudo[93754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:05 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-dd491d82-7e27-47b8-a9a7-563350ae1232 tempest-ServerRescueNegativeTestJSON-60814456 None] Lock "cinder-quobyte-983b965d-2499-4fbb-8df5-e7c54cdde823" acquired by "delete_volume" :: waited 0.035s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:33:05 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9039ed-e315-4b21-a5f7-27313bea4d96]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:33:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-dd491d82-7e27-47b8-a9a7-563350ae1232 tempest-ServerRescueNegativeTestJSON-60814456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-983b965d-2499-4fbb-8df5-e7c54cdde823 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:05 devstack sudo[93756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-983b965d-2499-4fbb-8df5-e7c54cdde823 Nov 02 15:33:05 devstack sudo[93756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:06 devstack sudo[93754]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bab43b54-6aea-4eef-b947-78c793d16786 tempest-VolumesTestJSON-426474820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7b839fbc-ad94-49a1-a6e7-07b54c76b3b4" returned: 0 in 1.041s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bab43b54-6aea-4eef-b947-78c793d16786 tempest-VolumesTestJSON-426474820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7b839fbc-ad94-49a1-a6e7-07b54c76b3b4 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:06 devstack sudo[93764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7b839fbc-ad94-49a1-a6e7-07b54c76b3b4 Nov 02 15:33:06 devstack sudo[93764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:06 devstack sudo[93756]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-dd491d82-7e27-47b8-a9a7-563350ae1232 tempest-ServerRescueNegativeTestJSON-60814456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-983b965d-2499-4fbb-8df5-e7c54cdde823" returned: 0 in 0.789s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-dd491d82-7e27-47b8-a9a7-563350ae1232 tempest-ServerRescueNegativeTestJSON-60814456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-983b965d-2499-4fbb-8df5-e7c54cdde823 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:06 devstack sudo[93767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-983b965d-2499-4fbb-8df5-e7c54cdde823 Nov 02 15:33:06 devstack sudo[93767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:07 devstack sudo[93764]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bab43b54-6aea-4eef-b947-78c793d16786 tempest-VolumesTestJSON-426474820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7b839fbc-ad94-49a1-a6e7-07b54c76b3b4" returned: 0 in 0.656s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:07 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-bab43b54-6aea-4eef-b947-78c793d16786 tempest-VolumesTestJSON-426474820 None] Lock "cinder-quobyte-7b839fbc-ad94-49a1-a6e7-07b54c76b3b4" released by "delete_volume" :: held 1.800s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:33:07 devstack sudo[93767]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-dd491d82-7e27-47b8-a9a7-563350ae1232 tempest-ServerRescueNegativeTestJSON-60814456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-983b965d-2499-4fbb-8df5-e7c54cdde823" returned: 0 in 0.609s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:07 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-dd491d82-7e27-47b8-a9a7-563350ae1232 tempest-ServerRescueNegativeTestJSON-60814456 None] Lock "cinder-quobyte-983b965d-2499-4fbb-8df5-e7c54cdde823" released by "delete_volume" :: held 1.513s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:33:07 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-bab43b54-6aea-4eef-b947-78c793d16786 tempest-VolumesTestJSON-426474820 None] Created reservations ['5c42ae1b-2a81-4698-9202-6c8713d8c9b3', '25ca0cbe-dc98-46ed-8077-b66b689d1850', '1fb83270-d10c-4e3c-9a8d-4d4fcc6cbd9f', '4e1b896c-53a0-4f9f-b374-3e05ad1ffeff'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:33:07 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-dd491d82-7e27-47b8-a9a7-563350ae1232 tempest-ServerRescueNegativeTestJSON-60814456 None] Created reservations ['0d57c4ba-d6ed-4d85-9136-046faaddafa9', '66a79482-7763-406f-bc12-9d6515e7fbde', '524c1bad-6634-4a84-8a08-ea5a6cb35d5d', '3345e1aa-5a23-4fea-adfe-7bffc4806d2c'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:33:07 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7bb30808-9053-4e12-b0e1-d4d70d7e5ed0 tempest-VolumesTestJSON-426474820 None] Acquiring lock "cinder-055eb7af-8d91-4adb-8bde-36afe69191fe-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:33:07 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7bb30808-9053-4e12-b0e1-d4d70d7e5ed0 tempest-VolumesTestJSON-426474820 None] Lock "cinder-055eb7af-8d91-4adb-8bde-36afe69191fe-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:33:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-bab43b54-6aea-4eef-b947-78c793d16786 tempest-VolumesTestJSON-426474820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:33:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-bab43b54-6aea-4eef-b947-78c793d16786 tempest-VolumesTestJSON-426474820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:33:07 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-bab43b54-6aea-4eef-b947-78c793d16786 tempest-VolumesTestJSON-426474820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:33:07 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-bab43b54-6aea-4eef-b947-78c793d16786 tempest-VolumesTestJSON-426474820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:33:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-bab43b54-6aea-4eef-b947-78c793d16786 tempest-VolumesTestJSON-426474820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:33:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bab43b54-6aea-4eef-b947-78c793d16786 tempest-VolumesTestJSON-426474820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:07 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7bb30808-9053-4e12-b0e1-d4d70d7e5ed0 tempest-VolumesTestJSON-426474820 None] Acquiring lock "cinder-quobyte-055eb7af-8d91-4adb-8bde-36afe69191fe" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:33:07 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7bb30808-9053-4e12-b0e1-d4d70d7e5ed0 tempest-VolumesTestJSON-426474820 None] Lock "cinder-quobyte-055eb7af-8d91-4adb-8bde-36afe69191fe" acquired by "delete_volume" :: waited 0.036s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:33:07 devstack sudo[93772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:33:07 devstack sudo[93772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-dd491d82-7e27-47b8-a9a7-563350ae1232 tempest-ServerRescueNegativeTestJSON-60814456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:33:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-dd491d82-7e27-47b8-a9a7-563350ae1232 tempest-ServerRescueNegativeTestJSON-60814456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:33:07 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-dd491d82-7e27-47b8-a9a7-563350ae1232 tempest-ServerRescueNegativeTestJSON-60814456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:33:07 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-dd491d82-7e27-47b8-a9a7-563350ae1232 tempest-ServerRescueNegativeTestJSON-60814456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:33:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-dd491d82-7e27-47b8-a9a7-563350ae1232 tempest-ServerRescueNegativeTestJSON-60814456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:33:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-dd491d82-7e27-47b8-a9a7-563350ae1232 tempest-ServerRescueNegativeTestJSON-60814456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:07 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[549796cd-49e1-4544-a082-6e5287f6ebc8]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:33:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7bb30808-9053-4e12-b0e1-d4d70d7e5ed0 tempest-VolumesTestJSON-426474820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-055eb7af-8d91-4adb-8bde-36afe69191fe {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:07 devstack sudo[93774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:33:07 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:08 devstack sudo[93775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-055eb7af-8d91-4adb-8bde-36afe69191fe Nov 02 15:33:08 devstack sudo[93775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:09 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-dd491d82-7e27-47b8-a9a7-563350ae1232 tempest-ServerRescueNegativeTestJSON-60814456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 1.359s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:09 devstack sudo[93772]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:09 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-dd491d82-7e27-47b8-a9a7-563350ae1232 tempest-ServerRescueNegativeTestJSON-60814456 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:33:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bab43b54-6aea-4eef-b947-78c793d16786 tempest-VolumesTestJSON-426474820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 1.565s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:09 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-bab43b54-6aea-4eef-b947-78c793d16786 tempest-VolumesTestJSON-426474820 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:33:09 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-dd491d82-7e27-47b8-a9a7-563350ae1232 tempest-ServerRescueNegativeTestJSON-60814456 None] Deleted volume successfully. Nov 02 15:33:09 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-dd491d82-7e27-47b8-a9a7-563350ae1232 tempest-ServerRescueNegativeTestJSON-60814456 None] Lock "cinder-983b965d-2499-4fbb-8df5-e7c54cdde823-delete_volume" released by "delete_volume" :: held 4.021s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:33:09 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-bab43b54-6aea-4eef-b947-78c793d16786 tempest-VolumesTestJSON-426474820 None] Deleted volume successfully. Nov 02 15:33:09 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-bab43b54-6aea-4eef-b947-78c793d16786 tempest-VolumesTestJSON-426474820 None] Lock "cinder-7b839fbc-ad94-49a1-a6e7-07b54c76b3b4-delete_volume" released by "delete_volume" :: held 4.581s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:33:09 devstack sudo[93775]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7bb30808-9053-4e12-b0e1-d4d70d7e5ed0 tempest-VolumesTestJSON-426474820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-055eb7af-8d91-4adb-8bde-36afe69191fe" returned: 0 in 1.960s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7bb30808-9053-4e12-b0e1-d4d70d7e5ed0 tempest-VolumesTestJSON-426474820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-055eb7af-8d91-4adb-8bde-36afe69191fe {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:10 devstack sudo[93801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-055eb7af-8d91-4adb-8bde-36afe69191fe Nov 02 15:33:10 devstack sudo[93801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:10 devstack sudo[93801]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7bb30808-9053-4e12-b0e1-d4d70d7e5ed0 tempest-VolumesTestJSON-426474820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-055eb7af-8d91-4adb-8bde-36afe69191fe" returned: 0 in 0.704s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:10 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7bb30808-9053-4e12-b0e1-d4d70d7e5ed0 tempest-VolumesTestJSON-426474820 None] Lock "cinder-quobyte-055eb7af-8d91-4adb-8bde-36afe69191fe" released by "delete_volume" :: held 2.870s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:33:10 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-7bb30808-9053-4e12-b0e1-d4d70d7e5ed0 tempest-VolumesTestJSON-426474820 None] Created reservations ['453b1911-4de8-4a0f-9768-9ec7e036f5ce', 'f0f0908b-dfe2-4cbb-abce-4799228d1e1e', 'f5e4dece-09d8-4c3a-83d0-b9315436e117', 'f87a404c-81cb-4126-b22e-ca0f70c2bb88'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:33:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7bb30808-9053-4e12-b0e1-d4d70d7e5ed0 tempest-VolumesTestJSON-426474820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:33:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7bb30808-9053-4e12-b0e1-d4d70d7e5ed0 tempest-VolumesTestJSON-426474820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:33:11 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7bb30808-9053-4e12-b0e1-d4d70d7e5ed0 tempest-VolumesTestJSON-426474820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:33:11 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7bb30808-9053-4e12-b0e1-d4d70d7e5ed0 tempest-VolumesTestJSON-426474820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:33:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7bb30808-9053-4e12-b0e1-d4d70d7e5ed0 tempest-VolumesTestJSON-426474820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:33:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7bb30808-9053-4e12-b0e1-d4d70d7e5ed0 tempest-VolumesTestJSON-426474820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:11 devstack sudo[93810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:33:11 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:11 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5c2becbc-d438-4bd7-a70d-abb976407335 tempest-VolumesTestJSON-426474820 None] Acquiring lock "cinder-b9829dc7-7b0a-4f71-8967-568fa7adc3e4-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:33:11 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5c2becbc-d438-4bd7-a70d-abb976407335 tempest-VolumesTestJSON-426474820 None] Lock "cinder-b9829dc7-7b0a-4f71-8967-568fa7adc3e4-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:33:11 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7bb30808-9053-4e12-b0e1-d4d70d7e5ed0 tempest-VolumesTestJSON-426474820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.764s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:11 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-7bb30808-9053-4e12-b0e1-d4d70d7e5ed0 tempest-VolumesTestJSON-426474820 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:33:11 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-7bb30808-9053-4e12-b0e1-d4d70d7e5ed0 tempest-VolumesTestJSON-426474820 None] Deleted volume successfully. Nov 02 15:33:11 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5c2becbc-d438-4bd7-a70d-abb976407335 tempest-VolumesTestJSON-426474820 None] Acquiring lock "cinder-quobyte-b9829dc7-7b0a-4f71-8967-568fa7adc3e4" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:33:11 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7bb30808-9053-4e12-b0e1-d4d70d7e5ed0 tempest-VolumesTestJSON-426474820 None] Lock "cinder-055eb7af-8d91-4adb-8bde-36afe69191fe-delete_volume" released by "delete_volume" :: held 4.267s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:33:11 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5c2becbc-d438-4bd7-a70d-abb976407335 tempest-VolumesTestJSON-426474820 None] Lock "cinder-quobyte-b9829dc7-7b0a-4f71-8967-568fa7adc3e4" acquired by "delete_volume" :: waited 0.076s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:33:11 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[611adf88-ca48-4f8f-9645-e9970c97e8f3]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:33:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5c2becbc-d438-4bd7-a70d-abb976407335 tempest-VolumesTestJSON-426474820 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b9829dc7-7b0a-4f71-8967-568fa7adc3e4 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:12 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:33:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] Flow 'volume_create_manager' (8592ed88-8037-41a2-9808-a1760a70ae51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:33:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee10e418-0649-41b3-91ba-1218d4153cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee10e418-0649-41b3-91ba-1218d4153cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1612176753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c21c3fdc-d184-430b-93f4-51b4b99141a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e89f1e429a49ba9df38ce5cefb945f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:33:12Z,use_quota=True,user_id='08f1bc68428c4d2390e7582b662fcd48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7da24d1-1997-4a53-9e3b-6fc719db76c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7da24d1-1997-4a53-9e3b-6fc719db76c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd9f6c87-72bf-4917-8ae5-52f02e382169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd9f6c87-72bf-4917-8ae5-52f02e382169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c21c3fdc-d184-430b-93f4-51b4b99141a2', 'volume_name': 'volume-c21c3fdc-d184-430b-93f4-51b4b99141a2', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04459453-8b1d-41e3-ad41-969feb3d7039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04459453-8b1d-41e3-ad41-969feb3d7039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c04da661-2718-4a48-959e-4930c2ec60dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:12 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] Volume c21c3fdc-d184-430b-93f4-51b4b99141a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c21c3fdc-d184-430b-93f4-51b4b99141a2', 'volume_size': 1} Nov 02 15:33:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:33:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:33:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1612176753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c21c3fdc-d184-430b-93f4-51b4b99141a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e89f1e429a49ba9df38ce5cefb945f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:33:12Z,use_quota=True,user_id='08f1bc68428c4d2390e7582b662fcd48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:33:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] Creating volume c21c3fdc-d184-430b-93f4-51b4b99141a2 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:33:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:33:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:33:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:33:12 devstack sudo[93813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b9829dc7-7b0a-4f71-8967-568fa7adc3e4 Nov 02 15:33:12 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:33:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:33:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:33:12 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:33:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:12 devstack sudo[93816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2 1073741824 Nov 02 15:33:12 devstack sudo[93816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:13 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5c2becbc-d438-4bd7-a70d-abb976407335 tempest-VolumesTestJSON-426474820 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b9829dc7-7b0a-4f71-8967-568fa7adc3e4" returned: 0 in 1.212s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5c2becbc-d438-4bd7-a70d-abb976407335 tempest-VolumesTestJSON-426474820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b9829dc7-7b0a-4f71-8967-568fa7adc3e4 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:13 devstack sudo[93823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b9829dc7-7b0a-4f71-8967-568fa7adc3e4 Nov 02 15:33:13 devstack sudo[93823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:13 devstack sudo[93823]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5c2becbc-d438-4bd7-a70d-abb976407335 tempest-VolumesTestJSON-426474820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b9829dc7-7b0a-4f71-8967-568fa7adc3e4" returned: 0 in 0.469s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:13 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5c2becbc-d438-4bd7-a70d-abb976407335 tempest-VolumesTestJSON-426474820 None] Lock "cinder-quobyte-b9829dc7-7b0a-4f71-8967-568fa7adc3e4" released by "delete_volume" :: held 1.789s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:33:13 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-5c2becbc-d438-4bd7-a70d-abb976407335 tempest-VolumesTestJSON-426474820 None] Created reservations ['584875cb-f8c0-42d4-9faa-fe11d59609a6', 'eeff1d11-7a42-449f-afb3-e641ea58bea1', '226810ad-6061-41f6-8723-956b4cc197eb', '0d622141-da1c-4201-aa66-24e5d60cb9ef'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:33:13 devstack sudo[93816]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2 1073741824" returned: 0 in 1.470s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5c2becbc-d438-4bd7-a70d-abb976407335 tempest-VolumesTestJSON-426474820 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:33:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5c2becbc-d438-4bd7-a70d-abb976407335 tempest-VolumesTestJSON-426474820 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:33:13 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-5c2becbc-d438-4bd7-a70d-abb976407335 tempest-VolumesTestJSON-426474820 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:33:13 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-5c2becbc-d438-4bd7-a70d-abb976407335 tempest-VolumesTestJSON-426474820 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:33:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5c2becbc-d438-4bd7-a70d-abb976407335 tempest-VolumesTestJSON-426474820 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:33:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5c2becbc-d438-4bd7-a70d-abb976407335 tempest-VolumesTestJSON-426474820 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:14 devstack sudo[93830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:33:14 devstack sudo[93830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:14 devstack sudo[93831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2 Nov 02 15:33:14 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:14 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2" returned: 0 in 0.541s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:14 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] <== create_volume: return (2171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:33:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.175s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:33:14 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c04da661-2718-4a48-959e-4930c2ec60dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c21c3fdc-d184-430b-93f4-51b4b99141a2', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:14 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4846c8ca-4c46-4d76-8291-c066503741ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:14 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] Volume volume-c21c3fdc-d184-430b-93f4-51b4b99141a2 (c21c3fdc-d184-430b-93f4-51b4b99141a2): created successfully Nov 02 15:33:14 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4846c8ca-4c46-4d76-8291-c066503741ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:14 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] Flow 'volume_create_manager' (8592ed88-8037-41a2-9808-a1760a70ae51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:33:14 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-c144b339-b584-4ef4-bc84-b5783fb41a8a tempest-VolumesCloneTest-255543010 None] Created volume successfully. Nov 02 15:33:14 devstack sudo[93830]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5c2becbc-d438-4bd7-a70d-abb976407335 tempest-VolumesTestJSON-426474820 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.874s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:14 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-5c2becbc-d438-4bd7-a70d-abb976407335 tempest-VolumesTestJSON-426474820 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:33:14 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-5c2becbc-d438-4bd7-a70d-abb976407335 tempest-VolumesTestJSON-426474820 None] Deleted volume successfully. Nov 02 15:33:14 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5c2becbc-d438-4bd7-a70d-abb976407335 tempest-VolumesTestJSON-426474820 None] Lock "cinder-b9829dc7-7b0a-4f71-8967-568fa7adc3e4-delete_volume" released by "delete_volume" :: held 3.215s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:33:17 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:33:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Flow 'volume_create_manager' (5dfb9fdf-a7b8-4995-8894-37e2ac890042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:33:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1881f2b2-144b-4dca-a2b0-a6f388e51c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1881f2b2-144b-4dca-a2b0-a6f388e51c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1046614263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=854e5c9e-f728-467c-8b0f-ac882d3f288e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4e89f1e429a49ba9df38ce5cefb945f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:33:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=c21c3fdc-d184-430b-93f4-51b4b99141a2,status='creating',terminated_at=None,updated_at=2026-11-02T14:33:17Z,use_quota=True,user_id='08f1bc68428c4d2390e7582b662fcd48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e41bb20-6e62-4908-9b94-1f8f41644d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e41bb20-6e62-4908-9b94-1f8f41644d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8ecf7ac-4351-4950-9a4f-340ef547467e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8ecf7ac-4351-4950-9a4f-340ef547467e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '854e5c9e-f728-467c-8b0f-ac882d3f288e', 'volume_name': 'volume-854e5c9e-f728-467c-8b0f-ac882d3f288e', 'volume_size': 2, 'source_volid': 'c21c3fdc-d184-430b-93f4-51b4b99141a2', 'source_volstatus': 'available'}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24eede29-ac26-44c0-b649-0412e3626f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24eede29-ac26-44c0-b649-0412e3626f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54091b75-ef4d-42a9-b1e9-75a8bd24ed41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:17 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Volume 854e5c9e-f728-467c-8b0f-ac882d3f288e: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-854e5c9e-f728-467c-8b0f-ac882d3f288e', 'volume_size': 2, 'source_volid': 'c21c3fdc-d184-430b-93f4-51b4b99141a2', 'source_volstatus': 'available'} Nov 02 15:33:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:33:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:33:17 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Cloning volume c21c3fdc-d184-430b-93f4-51b4b99141a2 to volume 854e5c9e-f728-467c-8b0f-ac882d3f288e Nov 02 15:33:17 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Creating offline snapshot a060771c-0a91-4b8a-a5b5-29446d6ee359 of volume c21c3fdc-d184-430b-93f4-51b4b99141a2 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:33:17 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[60248274-d828-48b4-8f1e-beef5c73f3e1]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:33:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:17 devstack sudo[93857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2 Nov 02 15:33:17 devstack sudo[93857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:18 devstack sudo[93857]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2" returned: 0 in 0.522s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2.a060771c-0a91-4b8a-a5b5-29446d6ee359 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:18 devstack sudo[93862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2.a060771c-0a91-4b8a-a5b5-29446d6ee359 1G Nov 02 15:33:18 devstack sudo[93862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:18 devstack sudo[93862]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2.a060771c-0a91-4b8a-a5b5-29446d6ee359 1G" returned: 0 in 0.706s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c21c3fdc-d184-430b-93f4-51b4b99141a2 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2.a060771c-0a91-4b8a-a5b5-29446d6ee359 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:18 devstack sudo[93870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c21c3fdc-d184-430b-93f4-51b4b99141a2 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2.a060771c-0a91-4b8a-a5b5-29446d6ee359 Nov 02 15:33:18 devstack sudo[93870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:19 devstack sudo[93870]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c21c3fdc-d184-430b-93f4-51b4b99141a2 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2.a060771c-0a91-4b8a-a5b5-29446d6ee359" returned: 0 in 0.376s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:19 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2.a060771c-0a91-4b8a-a5b5-29446d6ee359 is being set with open permissions: ugo+rw Nov 02 15:33:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2.a060771c-0a91-4b8a-a5b5-29446d6ee359 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:19 devstack sudo[93876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2.a060771c-0a91-4b8a-a5b5-29446d6ee359 Nov 02 15:33:19 devstack sudo[93876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:19 devstack sudo[93876]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2.a060771c-0a91-4b8a-a5b5-29446d6ee359" returned: 0 in 0.393s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:19 devstack sudo[93879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2.info Nov 02 15:33:19 devstack sudo[93879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:20 devstack sudo[93879]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2.info" returned: 0 in 0.355s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:20 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2.info is being set with open permissions: ugo+rw Nov 02 15:33:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:20 devstack sudo[93882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2.info Nov 02 15:33:20 devstack sudo[93882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:20 devstack sudo[93882]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2.info" returned: 0 in 0.340s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:20 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Acquiring lock "cinder-quobyte-854e5c9e-f728-467c-8b0f-ac882d3f288e" by "_copy_volume_from_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:33:20 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Lock "cinder-quobyte-854e5c9e-f728-467c-8b0f-ac882d3f288e" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:33:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] snapshot: a060771c-0a91-4b8a-a5b5-29446d6ee359, volume: 854e5c9e-f728-467c-8b0f-ac882d3f288e, {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 15:33:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:33:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:33:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:33:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:33:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:33:20 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:33:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:33:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:33:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:33:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:33:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:33:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:20 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[116c92be-e63f-4bae-96b0-f887cd2f3dca]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:33:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2.a060771c-0a91-4b8a-a5b5-29446d6ee359 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:20 devstack sudo[93885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:33:20 devstack sudo[93885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:20 devstack sudo[93886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2.a060771c-0a91-4b8a-a5b5-29446d6ee359 Nov 02 15:33:20 devstack sudo[93886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:21 devstack sudo[93886]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2.a060771c-0a91-4b8a-a5b5-29446d6ee359" returned: 0 in 0.449s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:21 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c21c3fdc-d184-430b-93f4-51b4b99141a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:33:21 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3e7d42-a419-452a-bf31-ee1560419dac]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:33:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:21 devstack sudo[93885]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.554s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:21 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:33:21 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager._thread_info {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:33:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread count: 29 {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 15:33:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread info: [<_MainThread(MainThread, started 125876361756800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 15:33:21 devstack sudo[93894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2 Nov 02 15:33:21 devstack sudo[93894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:21 devstack sudo[93894]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2" returned: 0 in 0.495s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:21 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] will copy from snapshot at /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2 {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 15:33:21 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Creating direct copy from snapshot {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 15:33:21 devstack cinder-volume[86703]: DEBUG cinder.utils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Path /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-854e5c9e-f728-467c-8b0f-ac882d3f288e not found in is_blk_device check {{(pid=86703) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 15:33:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-854e5c9e-f728-467c-8b0f-ac882d3f288e {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:21 devstack sudo[93902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-854e5c9e-f728-467c-8b0f-ac882d3f288e Nov 02 15:33:21 devstack sudo[93902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:29 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=47,cinder:UPDATE=75,cinder:INSERT=21,cinder:DELETE=7 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:33:29 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=68,cinder:UPDATE=71,cinder:DELETE=5,cinder:INSERT=15 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:33:31 devstack sudo[93902]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-854e5c9e-f728-467c-8b0f-ac882d3f288e" returned: 0 in 9.725s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:31 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Image conversion details: src /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2, size 1024.00 MB, duration 9.73 sec, destination /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-854e5c9e-f728-467c-8b0f-ac882d3f288e {{(pid=86703) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 15:33:31 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Converted 1024.00 MB image at 105.28 MB/s Nov 02 15:33:31 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-854e5c9e-f728-467c-8b0f-ac882d3f288e is being set with open permissions: ugo+rw Nov 02 15:33:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-854e5c9e-f728-467c-8b0f-ac882d3f288e {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:31 devstack sudo[93958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-854e5c9e-f728-467c-8b0f-ac882d3f288e Nov 02 15:33:31 devstack sudo[93958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:31 devstack sudo[93958]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-854e5c9e-f728-467c-8b0f-ac882d3f288e" returned: 0 in 0.249s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:31 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Lock "cinder-quobyte-854e5c9e-f728-467c-8b0f-ac882d3f288e" released by "_copy_volume_from_snapshot" :: held 11.060s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:33:31 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Acquiring lock "cinder-quobyte-a060771c-0a91-4b8a-a5b5-29446d6ee359" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:33:31 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Lock "cinder-quobyte-a060771c-0a91-4b8a-a5b5-29446d6ee359" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:33:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Deleting offline snapshot a060771c-0a91-4b8a-a5b5-29446d6ee359 of volume c21c3fdc-d184-430b-93f4-51b4b99141a2 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:33:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] snapshot_file for this snap is: volume-c21c3fdc-d184-430b-93f4-51b4b99141a2.a060771c-0a91-4b8a-a5b5-29446d6ee359 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:33:31 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[08dc4fc5-24d9-497a-8937-cc7d79a2dc23]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:33:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2.a060771c-0a91-4b8a-a5b5-29446d6ee359 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:31 devstack sudo[93961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2.a060771c-0a91-4b8a-a5b5-29446d6ee359 Nov 02 15:33:31 devstack sudo[93961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:32 devstack sudo[93961]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2.a060771c-0a91-4b8a-a5b5-29446d6ee359" returned: 0 in 0.402s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c21c3fdc-d184-430b-93f4-51b4b99141a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:33:32 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c4d886-e07e-44db-b481-0eced132fac5]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:33:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:32 devstack sudo[93966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2 Nov 02 15:33:32 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:32 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2" returned: 0 in 0.600s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2.a060771c-0a91-4b8a-a5b5-29446d6ee359 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:32 devstack sudo[93971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2.a060771c-0a91-4b8a-a5b5-29446d6ee359 Nov 02 15:33:32 devstack sudo[93971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:33 devstack sudo[93971]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2.a060771c-0a91-4b8a-a5b5-29446d6ee359" returned: 0 in 0.417s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2.a060771c-0a91-4b8a-a5b5-29446d6ee359 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:33 devstack sudo[93977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2.a060771c-0a91-4b8a-a5b5-29446d6ee359 Nov 02 15:33:33 devstack sudo[93977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:33 devstack sudo[93977]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2.a060771c-0a91-4b8a-a5b5-29446d6ee359" returned: 0 in 0.282s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Lock "cinder-quobyte-a060771c-0a91-4b8a-a5b5-29446d6ee359" released by "_delete_snapshot" :: held 1.839s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:33:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.901s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:33:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54091b75-ef4d-42a9-b1e9-75a8bd24ed41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-854e5c9e-f728-467c-8b0f-ac882d3f288e', 'volume_size': 2, 'source_volid': 'c21c3fdc-d184-430b-93f4-51b4b99141a2', 'source_volstatus': 'available'}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (412cb675-41e1-4ca8-b765-aa2791ab4e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:33 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Volume volume-854e5c9e-f728-467c-8b0f-ac882d3f288e (854e5c9e-f728-467c-8b0f-ac882d3f288e): created successfully Nov 02 15:33:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (412cb675-41e1-4ca8-b765-aa2791ab4e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Flow 'volume_create_manager' (5dfb9fdf-a7b8-4995-8894-37e2ac890042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:33:33 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-4814f7d5-73ea-4ffe-8a6c-e467d89b30d1 tempest-VolumesCloneTest-255543010 None] Created volume successfully. Nov 02 15:33:34 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-566698c1-b9bd-4f36-a660-7ccdd46e644c tempest-GroupsTest-2000442855 None] Group tempest-Group1-232474784: creating Nov 02 15:33:34 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-566698c1-b9bd-4f36-a660-7ccdd46e644c tempest-GroupsTest-2000442855 None] Group tempest-Group1-232474784: created successfully Nov 02 15:33:34 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-566698c1-b9bd-4f36-a660-7ccdd46e644c tempest-GroupsTest-2000442855 None] Create group completed successfully. Nov 02 15:33:34 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-82cf4b09-df63-4554-9d5c-031e4152de7e tempest-VolumesCloneTest-255543010 None] Acquiring lock "cinder-854e5c9e-f728-467c-8b0f-ac882d3f288e-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:33:34 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-82cf4b09-df63-4554-9d5c-031e4152de7e tempest-VolumesCloneTest-255543010 None] Lock "cinder-854e5c9e-f728-467c-8b0f-ac882d3f288e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:33:34 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-82cf4b09-df63-4554-9d5c-031e4152de7e tempest-VolumesCloneTest-255543010 None] Acquiring lock "cinder-quobyte-854e5c9e-f728-467c-8b0f-ac882d3f288e" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:33:34 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-82cf4b09-df63-4554-9d5c-031e4152de7e tempest-VolumesCloneTest-255543010 None] Lock "cinder-quobyte-854e5c9e-f728-467c-8b0f-ac882d3f288e" acquired by "delete_volume" :: waited 0.018s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:33:34 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f2a3eb-f8ed-4e9d-b4ab-134bf13c58a0]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:33:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-82cf4b09-df63-4554-9d5c-031e4152de7e tempest-VolumesCloneTest-255543010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-854e5c9e-f728-467c-8b0f-ac882d3f288e {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:34 devstack sudo[93980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-854e5c9e-f728-467c-8b0f-ac882d3f288e Nov 02 15:33:34 devstack sudo[93980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:35 devstack sudo[93980]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-82cf4b09-df63-4554-9d5c-031e4152de7e tempest-VolumesCloneTest-255543010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-854e5c9e-f728-467c-8b0f-ac882d3f288e" returned: 0 in 0.417s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-82cf4b09-df63-4554-9d5c-031e4152de7e tempest-VolumesCloneTest-255543010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-854e5c9e-f728-467c-8b0f-ac882d3f288e {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:35 devstack sudo[93986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-854e5c9e-f728-467c-8b0f-ac882d3f288e Nov 02 15:33:35 devstack sudo[93986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:35 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-6b5a6bcd-e848-4b16-9265-bf42a45eb0f6 tempest-GroupsTest-2000442855 None] Group tempest-Group2-699209246: creating Nov 02 15:33:35 devstack sudo[93986]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-82cf4b09-df63-4554-9d5c-031e4152de7e tempest-VolumesCloneTest-255543010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-854e5c9e-f728-467c-8b0f-ac882d3f288e" returned: 0 in 0.305s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-82cf4b09-df63-4554-9d5c-031e4152de7e tempest-VolumesCloneTest-255543010 None] Lock "cinder-quobyte-854e5c9e-f728-467c-8b0f-ac882d3f288e" released by "delete_volume" :: held 0.768s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:33:35 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-6b5a6bcd-e848-4b16-9265-bf42a45eb0f6 tempest-GroupsTest-2000442855 None] Group tempest-Group2-699209246: created successfully Nov 02 15:33:35 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-6b5a6bcd-e848-4b16-9265-bf42a45eb0f6 tempest-GroupsTest-2000442855 None] Create group completed successfully. Nov 02 15:33:35 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-82cf4b09-df63-4554-9d5c-031e4152de7e tempest-VolumesCloneTest-255543010 None] Created reservations ['8db298f5-de70-4251-b22a-57c6c64e4314', 'd131e40d-e50a-458f-b58e-c7844ccddd62', 'a27906ef-eef7-4cf7-8c57-a71d5a8fd90a', 'cd5e04bc-0b3e-41b3-90ee-c66b9cd98982'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:33:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-82cf4b09-df63-4554-9d5c-031e4152de7e tempest-VolumesCloneTest-255543010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:33:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-82cf4b09-df63-4554-9d5c-031e4152de7e tempest-VolumesCloneTest-255543010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:33:35 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-82cf4b09-df63-4554-9d5c-031e4152de7e tempest-VolumesCloneTest-255543010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:33:35 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-82cf4b09-df63-4554-9d5c-031e4152de7e tempest-VolumesCloneTest-255543010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:33:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-82cf4b09-df63-4554-9d5c-031e4152de7e tempest-VolumesCloneTest-255543010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:33:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-82cf4b09-df63-4554-9d5c-031e4152de7e tempest-VolumesCloneTest-255543010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:35 devstack sudo[93989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:33:35 devstack sudo[93989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:35 devstack sudo[93989]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5a09bb12-740a-4231-98a9-5736e56d1680 tempest-VolumesCloneTest-255543010 None] Acquiring lock "cinder-c21c3fdc-d184-430b-93f4-51b4b99141a2-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:33:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-82cf4b09-df63-4554-9d5c-031e4152de7e tempest-VolumesCloneTest-255543010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.278s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:35 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-82cf4b09-df63-4554-9d5c-031e4152de7e tempest-VolumesCloneTest-255543010 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:33:35 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-82cf4b09-df63-4554-9d5c-031e4152de7e tempest-VolumesCloneTest-255543010 None] Deleted volume successfully. Nov 02 15:33:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5a09bb12-740a-4231-98a9-5736e56d1680 tempest-VolumesCloneTest-255543010 None] Lock "cinder-c21c3fdc-d184-430b-93f4-51b4b99141a2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:33:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-82cf4b09-df63-4554-9d5c-031e4152de7e tempest-VolumesCloneTest-255543010 None] Lock "cinder-854e5c9e-f728-467c-8b0f-ac882d3f288e-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:33:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5a09bb12-740a-4231-98a9-5736e56d1680 tempest-VolumesCloneTest-255543010 None] Acquiring lock "cinder-quobyte-c21c3fdc-d184-430b-93f4-51b4b99141a2" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:33:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5a09bb12-740a-4231-98a9-5736e56d1680 tempest-VolumesCloneTest-255543010 None] Lock "cinder-quobyte-c21c3fdc-d184-430b-93f4-51b4b99141a2" acquired by "delete_volume" :: waited 0.018s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:33:36 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eaec0fe-6327-4f87-bd9b-731085a5f12d]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:33:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5a09bb12-740a-4231-98a9-5736e56d1680 tempest-VolumesCloneTest-255543010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:36 devstack sudo[93992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2 Nov 02 15:33:36 devstack sudo[93992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:36 devstack sudo[93992]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5a09bb12-740a-4231-98a9-5736e56d1680 tempest-VolumesCloneTest-255543010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2" returned: 0 in 0.416s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5a09bb12-740a-4231-98a9-5736e56d1680 tempest-VolumesCloneTest-255543010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:36 devstack sudo[93998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2 Nov 02 15:33:36 devstack sudo[93998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:36 devstack sudo[93998]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5a09bb12-740a-4231-98a9-5736e56d1680 tempest-VolumesCloneTest-255543010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c21c3fdc-d184-430b-93f4-51b4b99141a2" returned: 0 in 0.474s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:37 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5a09bb12-740a-4231-98a9-5736e56d1680 tempest-VolumesCloneTest-255543010 None] Lock "cinder-quobyte-c21c3fdc-d184-430b-93f4-51b4b99141a2" released by "delete_volume" :: held 0.974s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:33:37 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-5a09bb12-740a-4231-98a9-5736e56d1680 tempest-VolumesCloneTest-255543010 None] Created reservations ['5ed2d51f-8324-4082-91ff-72c38c232c3e', 'd041f3d5-3ba7-4126-a05b-e6772e3d6b8b', 'f00b676c-88d2-4ae0-926a-ebacf0c8f7c1', 'c07d814c-1053-44f4-859d-10832256ddd2'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:33:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5a09bb12-740a-4231-98a9-5736e56d1680 tempest-VolumesCloneTest-255543010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:33:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5a09bb12-740a-4231-98a9-5736e56d1680 tempest-VolumesCloneTest-255543010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:33:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-5a09bb12-740a-4231-98a9-5736e56d1680 tempest-VolumesCloneTest-255543010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:33:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-5a09bb12-740a-4231-98a9-5736e56d1680 tempest-VolumesCloneTest-255543010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:33:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5a09bb12-740a-4231-98a9-5736e56d1680 tempest-VolumesCloneTest-255543010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:33:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5a09bb12-740a-4231-98a9-5736e56d1680 tempest-VolumesCloneTest-255543010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:37 devstack sudo[94001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:33:37 devstack sudo[94001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:37 devstack sudo[94001]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5a09bb12-740a-4231-98a9-5736e56d1680 tempest-VolumesCloneTest-255543010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.500s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:37 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-5a09bb12-740a-4231-98a9-5736e56d1680 tempest-VolumesCloneTest-255543010 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:33:37 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-5a09bb12-740a-4231-98a9-5736e56d1680 tempest-VolumesCloneTest-255543010 None] Deleted volume successfully. Nov 02 15:33:37 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:33:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] Flow 'volume_create_manager' (f40db7ee-070c-4a9b-8cc9-e3848a8132c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:33:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddab2e40-044d-46ed-b497-812428f3c731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:37 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5a09bb12-740a-4231-98a9-5736e56d1680 tempest-VolumesCloneTest-255543010 None] Lock "cinder-c21c3fdc-d184-430b-93f4-51b4b99141a2-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:33:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddab2e40-044d-46ed-b497-812428f3c731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2080997570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4fa7ce9e-6377-475a-90f1-8d1b7917cc35,host='devstack@QuobyteHD#QuobyteHD',id=3ebe75cd-3202-4542-aefb-0d07b9be0df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed7fdcc9b27430eb64ddc345eb07dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:33:38Z,use_quota=True,user_id='4ccffc91cd794118934d9b43284640aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bcff34d9-e18a-41d6-a462-a6779c1f3929),volume_type_id=bcff34d9-e18a-41d6-a462-a6779c1f3929)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22fb4f73-34df-46a9-a822-a38430a1af14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22fb4f73-34df-46a9-a822-a38430a1af14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (965bd023-6bf1-4b0c-8278-c8f3e44a3207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (965bd023-6bf1-4b0c-8278-c8f3e44a3207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ebe75cd-3202-4542-aefb-0d07b9be0df5', 'volume_name': 'volume-3ebe75cd-3202-4542-aefb-0d07b9be0df5', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3580fbe-51fd-434c-af66-c7a881f55246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3580fbe-51fd-434c-af66-c7a881f55246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d9003ff-7810-4035-988b-32d2505ced82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:37 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] Volume 3ebe75cd-3202-4542-aefb-0d07b9be0df5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ebe75cd-3202-4542-aefb-0d07b9be0df5', 'volume_size': 1} Nov 02 15:33:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:33:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:33:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4fa7ce9e-6377-475a-90f1-8d1b7917cc35,created_at=2026-11-02T14:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2080997570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4fa7ce9e-6377-475a-90f1-8d1b7917cc35,host='devstack@QuobyteHD#QuobyteHD',id=3ebe75cd-3202-4542-aefb-0d07b9be0df5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed7fdcc9b27430eb64ddc345eb07dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:33:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:33:38Z,use_quota=True,user_id='4ccffc91cd794118934d9b43284640aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bcff34d9-e18a-41d6-a462-a6779c1f3929),volume_type_id=bcff34d9-e18a-41d6-a462-a6779c1f3929)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:33:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] Creating volume 3ebe75cd-3202-4542-aefb-0d07b9be0df5 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:33:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:33:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:33:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:33:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:33:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:33:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:33:37 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:33:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3ebe75cd-3202-4542-aefb-0d07b9be0df5 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:38 devstack sudo[94004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3ebe75cd-3202-4542-aefb-0d07b9be0df5 1073741824 Nov 02 15:33:38 devstack sudo[94004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:38 devstack sudo[94004]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3ebe75cd-3202-4542-aefb-0d07b9be0df5 1073741824" returned: 0 in 0.542s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3ebe75cd-3202-4542-aefb-0d07b9be0df5 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:38 devstack sudo[94018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3ebe75cd-3202-4542-aefb-0d07b9be0df5 Nov 02 15:33:38 devstack sudo[94018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:38 devstack sudo[94018]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3ebe75cd-3202-4542-aefb-0d07b9be0df5" returned: 0 in 0.391s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:33:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:33:39 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d9003ff-7810-4035-988b-32d2505ced82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ebe75cd-3202-4542-aefb-0d07b9be0df5', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:39 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7dac547-abd4-4187-9618-1b99d4498ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:39 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] Volume volume-3ebe75cd-3202-4542-aefb-0d07b9be0df5 (3ebe75cd-3202-4542-aefb-0d07b9be0df5): created successfully Nov 02 15:33:39 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7dac547-abd4-4187-9618-1b99d4498ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:39 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] Flow 'volume_create_manager' (f40db7ee-070c-4a9b-8cc9-e3848a8132c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:33:39 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-2159df55-1192-4038-9687-da2342a9402c tempest-GroupsTest-2000442855 None] Created volume successfully. Nov 02 15:33:41 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-1ff46f48-98d3-4694-81a5-a2d98888da37 tempest-GroupsTest-2000442855 None] Acquiring lock "cinder-quobyte-3ebe75cd-3202-4542-aefb-0d07b9be0df5" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:33:41 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-1ff46f48-98d3-4694-81a5-a2d98888da37 tempest-GroupsTest-2000442855 None] Lock "cinder-quobyte-3ebe75cd-3202-4542-aefb-0d07b9be0df5" acquired by "delete_volume" :: waited 0.036s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:33:41 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd736321-66d6-4456-b564-098581004f73]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:33:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1ff46f48-98d3-4694-81a5-a2d98888da37 tempest-GroupsTest-2000442855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3ebe75cd-3202-4542-aefb-0d07b9be0df5 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:41 devstack sudo[94023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3ebe75cd-3202-4542-aefb-0d07b9be0df5 Nov 02 15:33:41 devstack sudo[94023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:41 devstack sudo[94023]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1ff46f48-98d3-4694-81a5-a2d98888da37 tempest-GroupsTest-2000442855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3ebe75cd-3202-4542-aefb-0d07b9be0df5" returned: 0 in 0.656s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1ff46f48-98d3-4694-81a5-a2d98888da37 tempest-GroupsTest-2000442855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3ebe75cd-3202-4542-aefb-0d07b9be0df5 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:41 devstack sudo[94045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3ebe75cd-3202-4542-aefb-0d07b9be0df5 Nov 02 15:33:41 devstack sudo[94045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:42 devstack sudo[94045]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1ff46f48-98d3-4694-81a5-a2d98888da37 tempest-GroupsTest-2000442855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3ebe75cd-3202-4542-aefb-0d07b9be0df5" returned: 0 in 0.484s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:42 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-1ff46f48-98d3-4694-81a5-a2d98888da37 tempest-GroupsTest-2000442855 None] Lock "cinder-quobyte-3ebe75cd-3202-4542-aefb-0d07b9be0df5" released by "delete_volume" :: held 1.226s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:33:42 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-1ff46f48-98d3-4694-81a5-a2d98888da37 tempest-GroupsTest-2000442855 None] Created reservations ['d8f0ddb5-5ad0-4429-83c6-c5673169bfda'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:33:42 devstack cinder-volume[86703]: WARNING cinder.quota [None req-1ff46f48-98d3-4694-81a5-a2d98888da37 tempest-GroupsTest-2000442855 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1206604142 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1206604142, it is now deprecated. Please use the default quota class for default quota. Nov 02 15:33:42 devstack cinder-volume[86703]: WARNING cinder.quota [None req-1ff46f48-98d3-4694-81a5-a2d98888da37 tempest-GroupsTest-2000442855 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1206604142 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1206604142, it is now deprecated. Please use the default quota class for default quota. Nov 02 15:33:42 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-1ff46f48-98d3-4694-81a5-a2d98888da37 tempest-GroupsTest-2000442855 None] Created reservations ['4f68aebf-5335-48e4-89cf-9c5055b94971', 'b31231ae-d3a9-4d39-99b3-6276c110488b', '3b95f55d-a490-4a64-9c2e-f04bc7665121', 'de72469f-3e03-4076-b005-f5733f2ebe45'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:33:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1ff46f48-98d3-4694-81a5-a2d98888da37 tempest-GroupsTest-2000442855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:33:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1ff46f48-98d3-4694-81a5-a2d98888da37 tempest-GroupsTest-2000442855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:33:42 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1ff46f48-98d3-4694-81a5-a2d98888da37 tempest-GroupsTest-2000442855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:33:42 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1ff46f48-98d3-4694-81a5-a2d98888da37 tempest-GroupsTest-2000442855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:33:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1ff46f48-98d3-4694-81a5-a2d98888da37 tempest-GroupsTest-2000442855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:33:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1ff46f48-98d3-4694-81a5-a2d98888da37 tempest-GroupsTest-2000442855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:42 devstack sudo[94053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:33:42 devstack sudo[94053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:43 devstack sudo[94053]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1ff46f48-98d3-4694-81a5-a2d98888da37 tempest-GroupsTest-2000442855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.356s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:43 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-1ff46f48-98d3-4694-81a5-a2d98888da37 tempest-GroupsTest-2000442855 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:33:43 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-1ff46f48-98d3-4694-81a5-a2d98888da37 tempest-GroupsTest-2000442855 None] Delete group completed successfully. Nov 02 15:33:43 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-b45c1dc5-bd65-484a-97e9-7d2c7228ecd3 tempest-GroupsTest-2000442855 None] Created reservations ['2ae91cfe-b87b-4653-a90b-b35a5de90b1a'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:33:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b45c1dc5-bd65-484a-97e9-7d2c7228ecd3 tempest-GroupsTest-2000442855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:33:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b45c1dc5-bd65-484a-97e9-7d2c7228ecd3 tempest-GroupsTest-2000442855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:33:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b45c1dc5-bd65-484a-97e9-7d2c7228ecd3 tempest-GroupsTest-2000442855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:33:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b45c1dc5-bd65-484a-97e9-7d2c7228ecd3 tempest-GroupsTest-2000442855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:33:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b45c1dc5-bd65-484a-97e9-7d2c7228ecd3 tempest-GroupsTest-2000442855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:33:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b45c1dc5-bd65-484a-97e9-7d2c7228ecd3 tempest-GroupsTest-2000442855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:43 devstack sudo[94058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:33:43 devstack sudo[94058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:44 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:33:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] Flow 'volume_create_manager' (aa535bd8-81ad-4078-9bae-b6df9803551a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:33:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d50f31-dae0-42fc-99a7-1f5b461dde61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d50f31-dae0-42fc-99a7-1f5b461dde61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-75940148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ee95740-8557-4c4a-b817-0432fa26f404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c26cb4edcbb441c86e722a2152e3294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:33:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:33:44Z,use_quota=True,user_id='85cf36b22ff145b09dce774d7828af68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (104a8a51-7072-47ee-8e77-b9aaef0cee8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (104a8a51-7072-47ee-8e77-b9aaef0cee8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1515373a-b00d-4d7a-9d9b-49b3ff4a40d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1515373a-b00d-4d7a-9d9b-49b3ff4a40d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ee95740-8557-4c4a-b817-0432fa26f404', 'volume_name': 'volume-3ee95740-8557-4c4a-b817-0432fa26f404', 'volume_size': 2}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c95d1fe0-4a60-4d40-a54b-8d3b95541122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c95d1fe0-4a60-4d40-a54b-8d3b95541122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:44 devstack sudo[94058]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32856c57-ec31-486d-a2e0-bcc57de0e002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:44 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] Volume 3ee95740-8557-4c4a-b817-0432fa26f404: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ee95740-8557-4c4a-b817-0432fa26f404', 'volume_size': 2} Nov 02 15:33:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:33:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:33:44 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-75940148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ee95740-8557-4c4a-b817-0432fa26f404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c26cb4edcbb441c86e722a2152e3294',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:33:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:33:44Z,use_quota=True,user_id='85cf36b22ff145b09dce774d7828af68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:33:44 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] Creating volume 3ee95740-8557-4c4a-b817-0432fa26f404 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:33:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:33:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:33:44 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:33:44 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:33:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:33:44 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:33:44 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:33:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3ee95740-8557-4c4a-b817-0432fa26f404 2147483648 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b45c1dc5-bd65-484a-97e9-7d2c7228ecd3 tempest-GroupsTest-2000442855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.401s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:44 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-b45c1dc5-bd65-484a-97e9-7d2c7228ecd3 tempest-GroupsTest-2000442855 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:33:44 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-b45c1dc5-bd65-484a-97e9-7d2c7228ecd3 tempest-GroupsTest-2000442855 None] Delete group completed successfully. Nov 02 15:33:44 devstack sudo[94061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3ee95740-8557-4c4a-b817-0432fa26f404 2147483648 Nov 02 15:33:44 devstack sudo[94061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:44 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-629764b1-0c72-41cd-ad3c-1e5f69157279 req-0325fd36-de88-4d3d-88a2-0824c8dc8337 tempest-ServerActionsTestOtherA-1672913331 None] Terminate volume connection completed successfully. Nov 02 15:33:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-629764b1-0c72-41cd-ad3c-1e5f69157279 req-0325fd36-de88-4d3d-88a2-0824c8dc8337 tempest-ServerActionsTestOtherA-1672913331 None] Deleting attachment 3756e51b-f0f3-40cb-ba04-0818debfada1. {{(pid=86703) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 15:33:44 devstack cinder-volume[86703]: DEBUG cinder.coordination [req-629764b1-0c72-41cd-ad3c-1e5f69157279 req-154ba4ac-d4ca-4b6c-9dde-42500e48cf4e tempest-ServerActionsTestOtherA-1672913331 None] Acquiring lock "cinder-e447838d-a9bf-49af-84b7-a7f2e65c9a5d-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:33:44 devstack cinder-volume[86703]: DEBUG cinder.coordination [req-629764b1-0c72-41cd-ad3c-1e5f69157279 req-154ba4ac-d4ca-4b6c-9dde-42500e48cf4e tempest-ServerActionsTestOtherA-1672913331 None] Lock "cinder-e447838d-a9bf-49af-84b7-a7f2e65c9a5d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:33:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [req-629764b1-0c72-41cd-ad3c-1e5f69157279 req-154ba4ac-d4ca-4b6c-9dde-42500e48cf4e tempest-ServerActionsTestOtherA-1672913331 None] Acquiring lock "cinder-quobyte-e447838d-a9bf-49af-84b7-a7f2e65c9a5d" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:33:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [req-629764b1-0c72-41cd-ad3c-1e5f69157279 req-154ba4ac-d4ca-4b6c-9dde-42500e48cf4e tempest-ServerActionsTestOtherA-1672913331 None] Lock "cinder-quobyte-e447838d-a9bf-49af-84b7-a7f2e65c9a5d" acquired by "delete_volume" :: waited 0.028s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:33:45 devstack sudo[94061]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3ee95740-8557-4c4a-b817-0432fa26f404 2147483648" returned: 0 in 0.903s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:45 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55968b2-d497-4115-9966-ed6ba6a2cfcf]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:33:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-629764b1-0c72-41cd-ad3c-1e5f69157279 req-154ba4ac-d4ca-4b6c-9dde-42500e48cf4e tempest-ServerActionsTestOtherA-1672913331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e447838d-a9bf-49af-84b7-a7f2e65c9a5d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3ee95740-8557-4c4a-b817-0432fa26f404 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:45 devstack sudo[94070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3ee95740-8557-4c4a-b817-0432fa26f404 Nov 02 15:33:45 devstack sudo[94070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:45 devstack sudo[94069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e447838d-a9bf-49af-84b7-a7f2e65c9a5d Nov 02 15:33:45 devstack sudo[94069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:45 devstack sudo[94070]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3ee95740-8557-4c4a-b817-0432fa26f404" returned: 0 in 0.381s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:45 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:33:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:33:45 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32856c57-ec31-486d-a2e0-bcc57de0e002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ee95740-8557-4c4a-b817-0432fa26f404', 'volume_size': 2}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:45 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c017171-0038-43c1-831c-3686ec031965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:45 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] Volume volume-3ee95740-8557-4c4a-b817-0432fa26f404 (3ee95740-8557-4c4a-b817-0432fa26f404): created successfully Nov 02 15:33:45 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c017171-0038-43c1-831c-3686ec031965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:45 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] Flow 'volume_create_manager' (aa535bd8-81ad-4078-9bae-b6df9803551a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:33:45 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-92dbf629-d869-46b1-a91d-b4053869690e tempest-VolumesCloneNegativeTest-666465114 None] Created volume successfully. Nov 02 15:33:45 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-a2038389-badb-43d8-979a-9dd2b656d6b6 tempest-GroupsTest-2000442855 None] Group tempest-GroupsTest-Group-786331886: creating Nov 02 15:33:45 devstack sudo[94069]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-629764b1-0c72-41cd-ad3c-1e5f69157279 req-154ba4ac-d4ca-4b6c-9dde-42500e48cf4e tempest-ServerActionsTestOtherA-1672913331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e447838d-a9bf-49af-84b7-a7f2e65c9a5d" returned: 0 in 0.710s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-629764b1-0c72-41cd-ad3c-1e5f69157279 req-154ba4ac-d4ca-4b6c-9dde-42500e48cf4e tempest-ServerActionsTestOtherA-1672913331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e447838d-a9bf-49af-84b7-a7f2e65c9a5d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:45 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-a2038389-badb-43d8-979a-9dd2b656d6b6 tempest-GroupsTest-2000442855 None] Group tempest-GroupsTest-Group-786331886: created successfully Nov 02 15:33:45 devstack sudo[94080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e447838d-a9bf-49af-84b7-a7f2e65c9a5d Nov 02 15:33:45 devstack sudo[94080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:45 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-a2038389-badb-43d8-979a-9dd2b656d6b6 tempest-GroupsTest-2000442855 None] Create group completed successfully. Nov 02 15:33:46 devstack sudo[94080]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-629764b1-0c72-41cd-ad3c-1e5f69157279 req-154ba4ac-d4ca-4b6c-9dde-42500e48cf4e tempest-ServerActionsTestOtherA-1672913331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e447838d-a9bf-49af-84b7-a7f2e65c9a5d" returned: 0 in 0.271s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:46 devstack cinder-volume[86703]: DEBUG cinder.coordination [req-629764b1-0c72-41cd-ad3c-1e5f69157279 req-154ba4ac-d4ca-4b6c-9dde-42500e48cf4e tempest-ServerActionsTestOtherA-1672913331 None] Lock "cinder-quobyte-e447838d-a9bf-49af-84b7-a7f2e65c9a5d" released by "delete_volume" :: held 1.062s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:33:46 devstack cinder-volume[86703]: DEBUG cinder.quota [req-629764b1-0c72-41cd-ad3c-1e5f69157279 req-154ba4ac-d4ca-4b6c-9dde-42500e48cf4e tempest-ServerActionsTestOtherA-1672913331 None] Created reservations ['21b26dfb-987e-4062-ba86-06b34d8a7170', '0e431145-2164-4bdf-abfc-20a6330507be', '0f847ea4-b3b2-4f56-9f70-ec7e92e925bc', 'f3d1bb1f-8294-4664-a7af-6faaecc45088'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:33:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-629764b1-0c72-41cd-ad3c-1e5f69157279 req-154ba4ac-d4ca-4b6c-9dde-42500e48cf4e tempest-ServerActionsTestOtherA-1672913331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:33:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-629764b1-0c72-41cd-ad3c-1e5f69157279 req-154ba4ac-d4ca-4b6c-9dde-42500e48cf4e tempest-ServerActionsTestOtherA-1672913331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:33:46 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [req-629764b1-0c72-41cd-ad3c-1e5f69157279 req-154ba4ac-d4ca-4b6c-9dde-42500e48cf4e tempest-ServerActionsTestOtherA-1672913331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:33:46 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [req-629764b1-0c72-41cd-ad3c-1e5f69157279 req-154ba4ac-d4ca-4b6c-9dde-42500e48cf4e tempest-ServerActionsTestOtherA-1672913331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:33:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-629764b1-0c72-41cd-ad3c-1e5f69157279 req-154ba4ac-d4ca-4b6c-9dde-42500e48cf4e tempest-ServerActionsTestOtherA-1672913331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:33:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-629764b1-0c72-41cd-ad3c-1e5f69157279 req-154ba4ac-d4ca-4b6c-9dde-42500e48cf4e tempest-ServerActionsTestOtherA-1672913331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:46 devstack sudo[94083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:33:46 devstack sudo[94083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:46 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-dfd1d879-ca6d-44f5-992f-ea71e65c2222 tempest-ServerActionsTestOtherA-1672913331 None] Acquiring lock "cinder-f58cae23-88e1-4190-ab35-fe097b8f0861-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:33:46 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-900d80a2-7fc6-4f14-89d8-e58c65951df6 tempest-VolumesCloneNegativeTest-666465114 None] Acquiring lock "cinder-3ee95740-8557-4c4a-b817-0432fa26f404-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:33:46 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-dfd1d879-ca6d-44f5-992f-ea71e65c2222 tempest-ServerActionsTestOtherA-1672913331 None] Lock "cinder-f58cae23-88e1-4190-ab35-fe097b8f0861-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:33:46 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-900d80a2-7fc6-4f14-89d8-e58c65951df6 tempest-VolumesCloneNegativeTest-666465114 None] Lock "cinder-3ee95740-8557-4c4a-b817-0432fa26f404-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:33:46 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-dfd1d879-ca6d-44f5-992f-ea71e65c2222 tempest-ServerActionsTestOtherA-1672913331 None] Acquiring lock "cinder-quobyte-f58cae23-88e1-4190-ab35-fe097b8f0861" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:33:46 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-900d80a2-7fc6-4f14-89d8-e58c65951df6 tempest-VolumesCloneNegativeTest-666465114 None] Acquiring lock "cinder-quobyte-3ee95740-8557-4c4a-b817-0432fa26f404" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:33:46 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-900d80a2-7fc6-4f14-89d8-e58c65951df6 tempest-VolumesCloneNegativeTest-666465114 None] Lock "cinder-quobyte-3ee95740-8557-4c4a-b817-0432fa26f404" acquired by "delete_volume" :: waited 0.017s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:33:46 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-dfd1d879-ca6d-44f5-992f-ea71e65c2222 tempest-ServerActionsTestOtherA-1672913331 None] Lock "cinder-quobyte-f58cae23-88e1-4190-ab35-fe097b8f0861" acquired by "delete_volume" :: waited 0.038s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:33:46 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6836ac-d5ee-44f2-ac10-9d8b43755c06]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:33:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-900d80a2-7fc6-4f14-89d8-e58c65951df6 tempest-VolumesCloneNegativeTest-666465114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3ee95740-8557-4c4a-b817-0432fa26f404 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:46 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[09dd2224-0600-4493-9fb4-12cd07d3ab13]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:33:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-dfd1d879-ca6d-44f5-992f-ea71e65c2222 tempest-ServerActionsTestOtherA-1672913331 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f58cae23-88e1-4190-ab35-fe097b8f0861 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:46 devstack sudo[94083]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-629764b1-0c72-41cd-ad3c-1e5f69157279 req-154ba4ac-d4ca-4b6c-9dde-42500e48cf4e tempest-ServerActionsTestOtherA-1672913331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.418s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:46 devstack cinder-volume[86703]: DEBUG cinder.manager [req-629764b1-0c72-41cd-ad3c-1e5f69157279 req-154ba4ac-d4ca-4b6c-9dde-42500e48cf4e tempest-ServerActionsTestOtherA-1672913331 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:33:46 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-629764b1-0c72-41cd-ad3c-1e5f69157279 req-154ba4ac-d4ca-4b6c-9dde-42500e48cf4e tempest-ServerActionsTestOtherA-1672913331 None] Deleted volume successfully. Nov 02 15:33:46 devstack cinder-volume[86703]: DEBUG cinder.coordination [req-629764b1-0c72-41cd-ad3c-1e5f69157279 req-154ba4ac-d4ca-4b6c-9dde-42500e48cf4e tempest-ServerActionsTestOtherA-1672913331 None] Lock "cinder-e447838d-a9bf-49af-84b7-a7f2e65c9a5d-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:33:46 devstack sudo[94087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f58cae23-88e1-4190-ab35-fe097b8f0861 Nov 02 15:33:46 devstack sudo[94087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:46 devstack sudo[94086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3ee95740-8557-4c4a-b817-0432fa26f404 Nov 02 15:33:46 devstack sudo[94086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:47 devstack sudo[94087]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-dfd1d879-ca6d-44f5-992f-ea71e65c2222 tempest-ServerActionsTestOtherA-1672913331 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f58cae23-88e1-4190-ab35-fe097b8f0861" returned: 0 in 0.405s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-dfd1d879-ca6d-44f5-992f-ea71e65c2222 tempest-ServerActionsTestOtherA-1672913331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f58cae23-88e1-4190-ab35-fe097b8f0861 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:47 devstack sudo[94097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f58cae23-88e1-4190-ab35-fe097b8f0861 Nov 02 15:33:47 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:47 devstack sudo[94086]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-900d80a2-7fc6-4f14-89d8-e58c65951df6 tempest-VolumesCloneNegativeTest-666465114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3ee95740-8557-4c4a-b817-0432fa26f404" returned: 0 in 0.468s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-900d80a2-7fc6-4f14-89d8-e58c65951df6 tempest-VolumesCloneNegativeTest-666465114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3ee95740-8557-4c4a-b817-0432fa26f404 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:47 devstack sudo[94099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3ee95740-8557-4c4a-b817-0432fa26f404 Nov 02 15:33:47 devstack sudo[94099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:47 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-dfd1d879-ca6d-44f5-992f-ea71e65c2222 tempest-ServerActionsTestOtherA-1672913331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f58cae23-88e1-4190-ab35-fe097b8f0861" returned: 0 in 0.301s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:47 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-dfd1d879-ca6d-44f5-992f-ea71e65c2222 tempest-ServerActionsTestOtherA-1672913331 None] Lock "cinder-quobyte-f58cae23-88e1-4190-ab35-fe097b8f0861" released by "delete_volume" :: held 0.772s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:33:47 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-dfd1d879-ca6d-44f5-992f-ea71e65c2222 tempest-ServerActionsTestOtherA-1672913331 None] Created reservations ['48dd1393-cd85-4f0d-ae0b-08042fa0cda6', 'e3fb08d6-4250-4b0e-a696-bb3299517455', '9e8c1c90-84f5-47ab-87de-40b7db5e58fe', 'a92d4101-5bba-4ec9-83ca-e5a019f179ee'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:33:47 devstack sudo[94099]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-900d80a2-7fc6-4f14-89d8-e58c65951df6 tempest-VolumesCloneNegativeTest-666465114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3ee95740-8557-4c4a-b817-0432fa26f404" returned: 0 in 0.421s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:47 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-900d80a2-7fc6-4f14-89d8-e58c65951df6 tempest-VolumesCloneNegativeTest-666465114 None] Lock "cinder-quobyte-3ee95740-8557-4c4a-b817-0432fa26f404" released by "delete_volume" :: held 0.953s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:33:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-dfd1d879-ca6d-44f5-992f-ea71e65c2222 tempest-ServerActionsTestOtherA-1672913331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:33:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-dfd1d879-ca6d-44f5-992f-ea71e65c2222 tempest-ServerActionsTestOtherA-1672913331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:33:47 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-dfd1d879-ca6d-44f5-992f-ea71e65c2222 tempest-ServerActionsTestOtherA-1672913331 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:33:47 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-dfd1d879-ca6d-44f5-992f-ea71e65c2222 tempest-ServerActionsTestOtherA-1672913331 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:33:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-dfd1d879-ca6d-44f5-992f-ea71e65c2222 tempest-ServerActionsTestOtherA-1672913331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:33:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-dfd1d879-ca6d-44f5-992f-ea71e65c2222 tempest-ServerActionsTestOtherA-1672913331 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:47 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:33:47 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:47 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-900d80a2-7fc6-4f14-89d8-e58c65951df6 tempest-VolumesCloneNegativeTest-666465114 None] Created reservations ['8e37cc5b-40de-4583-8769-e477281ebbcf', '0eb52225-724b-45ec-9dcf-d08309e6ebc1', '0a00aff8-bbec-4db3-9292-bff43216bb95', 'dacd4fe3-5eb7-450e-9f42-26761198440a'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:33:47 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:33:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] Flow 'volume_create_manager' (2d03dcda-14c8-435e-ac8f-1508d9fe076e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:33:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de5e6f84-36ad-4494-8090-901e0d98f2a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-900d80a2-7fc6-4f14-89d8-e58c65951df6 tempest-VolumesCloneNegativeTest-666465114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:33:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-900d80a2-7fc6-4f14-89d8-e58c65951df6 tempest-VolumesCloneNegativeTest-666465114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:33:47 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-900d80a2-7fc6-4f14-89d8-e58c65951df6 tempest-VolumesCloneNegativeTest-666465114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:33:47 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-900d80a2-7fc6-4f14-89d8-e58c65951df6 tempest-VolumesCloneNegativeTest-666465114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:33:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-900d80a2-7fc6-4f14-89d8-e58c65951df6 tempest-VolumesCloneNegativeTest-666465114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:33:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-900d80a2-7fc6-4f14-89d8-e58c65951df6 tempest-VolumesCloneNegativeTest-666465114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de5e6f84-36ad-4494-8090-901e0d98f2a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-667294233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=726a609f-d8c6-4176-9a8b-90d97fb34aa7,host='devstack@QuobyteHD#QuobyteHD',id=aa3fc952-e457-4488-b161-f831dbee6351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed7fdcc9b27430eb64ddc345eb07dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:33:48Z,use_quota=True,user_id='4ccffc91cd794118934d9b43284640aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1397418f-37fd-4a62-8894-94d124423f98),volume_type_id=1397418f-37fd-4a62-8894-94d124423f98)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c559c84-f70d-4248-8204-5e8e719d9f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:47 devstack sudo[94105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:33:47 devstack sudo[94105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c559c84-f70d-4248-8204-5e8e719d9f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (040b0248-af0e-4514-8596-173205046b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (040b0248-af0e-4514-8596-173205046b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa3fc952-e457-4488-b161-f831dbee6351', 'volume_name': 'volume-aa3fc952-e457-4488-b161-f831dbee6351', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d262e5-6f47-49c3-996b-9f11c778553e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d262e5-6f47-49c3-996b-9f11c778553e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56278d79-69db-479c-bc65-8e0f549ddc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:48 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] Volume aa3fc952-e457-4488-b161-f831dbee6351: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa3fc952-e457-4488-b161-f831dbee6351', 'volume_size': 1} Nov 02 15:33:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:33:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:33:48 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=726a609f-d8c6-4176-9a8b-90d97fb34aa7,created_at=2026-11-02T14:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-667294233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=726a609f-d8c6-4176-9a8b-90d97fb34aa7,host='devstack@QuobyteHD#QuobyteHD',id=aa3fc952-e457-4488-b161-f831dbee6351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed7fdcc9b27430eb64ddc345eb07dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:33:48Z,use_quota=True,user_id='4ccffc91cd794118934d9b43284640aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1397418f-37fd-4a62-8894-94d124423f98),volume_type_id=1397418f-37fd-4a62-8894-94d124423f98)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:33:48 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] Creating volume aa3fc952-e457-4488-b161-f831dbee6351 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:33:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:33:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:33:48 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:33:48 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:33:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:33:48 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:33:48 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:33:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-aa3fc952-e457-4488-b161-f831dbee6351 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:48 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-dfd1d879-ca6d-44f5-992f-ea71e65c2222 tempest-ServerActionsTestOtherA-1672913331 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.440s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:48 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-dfd1d879-ca6d-44f5-992f-ea71e65c2222 tempest-ServerActionsTestOtherA-1672913331 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:33:48 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-dfd1d879-ca6d-44f5-992f-ea71e65c2222 tempest-ServerActionsTestOtherA-1672913331 None] Deleted volume successfully. Nov 02 15:33:48 devstack sudo[94110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-aa3fc952-e457-4488-b161-f831dbee6351 1073741824 Nov 02 15:33:48 devstack sudo[94110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:48 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-dfd1d879-ca6d-44f5-992f-ea71e65c2222 tempest-ServerActionsTestOtherA-1672913331 None] Lock "cinder-f58cae23-88e1-4190-ab35-fe097b8f0861-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:33:48 devstack sudo[94105]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-900d80a2-7fc6-4f14-89d8-e58c65951df6 tempest-VolumesCloneNegativeTest-666465114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.476s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:48 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-900d80a2-7fc6-4f14-89d8-e58c65951df6 tempest-VolumesCloneNegativeTest-666465114 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:33:48 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-900d80a2-7fc6-4f14-89d8-e58c65951df6 tempest-VolumesCloneNegativeTest-666465114 None] Deleted volume successfully. Nov 02 15:33:48 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-900d80a2-7fc6-4f14-89d8-e58c65951df6 tempest-VolumesCloneNegativeTest-666465114 None] Lock "cinder-3ee95740-8557-4c4a-b817-0432fa26f404-delete_volume" released by "delete_volume" :: held 1.891s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:33:48 devstack sudo[94110]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-aa3fc952-e457-4488-b161-f831dbee6351 1073741824" returned: 0 in 0.816s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-aa3fc952-e457-4488-b161-f831dbee6351 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:49 devstack sudo[94135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-aa3fc952-e457-4488-b161-f831dbee6351 Nov 02 15:33:49 devstack sudo[94135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:49 devstack sudo[94135]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-aa3fc952-e457-4488-b161-f831dbee6351" returned: 0 in 0.403s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:33:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:33:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56278d79-69db-479c-bc65-8e0f549ddc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa3fc952-e457-4488-b161-f831dbee6351', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86bfd637-80fb-4923-8bb1-453f1c269cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:49 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] Volume volume-aa3fc952-e457-4488-b161-f831dbee6351 (aa3fc952-e457-4488-b161-f831dbee6351): created successfully Nov 02 15:33:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86bfd637-80fb-4923-8bb1-453f1c269cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] Flow 'volume_create_manager' (2d03dcda-14c8-435e-ac8f-1508d9fe076e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:33:49 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-0c55b032-1adf-4a73-8053-955d062342ec tempest-GroupsTest-2000442855 None] Created volume successfully. Nov 02 15:33:51 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:33:51 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] Flow 'volume_create_manager' (59d18e09-c390-47e2-a96b-2ab1b6b12ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:33:51 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcefadc4-665b-4330-96b8-9f6b9df83c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:51 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcefadc4-665b-4330-96b8-9f6b9df83c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-718631389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=726a609f-d8c6-4176-9a8b-90d97fb34aa7,host='devstack@QuobyteHD#QuobyteHD',id=7a7523af-90db-42f4-9983-295bdb6ecce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed7fdcc9b27430eb64ddc345eb07dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:33:51Z,use_quota=True,user_id='4ccffc91cd794118934d9b43284640aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1397418f-37fd-4a62-8894-94d124423f98),volume_type_id=1397418f-37fd-4a62-8894-94d124423f98)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:51 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6768218-a3aa-4377-89fc-affd4a30f503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:51 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6768218-a3aa-4377-89fc-affd4a30f503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:51 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f7525f5-6682-4c90-9414-5bf4eb97a289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:51 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f7525f5-6682-4c90-9414-5bf4eb97a289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a7523af-90db-42f4-9983-295bdb6ecce6', 'volume_name': 'volume-7a7523af-90db-42f4-9983-295bdb6ecce6', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:51 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1c98836-b2ed-4701-8229-4906d6ce28e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:51 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1c98836-b2ed-4701-8229-4906d6ce28e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:51 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9619ab29-a55e-48eb-870e-2eedd6d81b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:51 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] Volume 7a7523af-90db-42f4-9983-295bdb6ecce6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a7523af-90db-42f4-9983-295bdb6ecce6', 'volume_size': 1} Nov 02 15:33:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:33:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:33:51 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=726a609f-d8c6-4176-9a8b-90d97fb34aa7,created_at=2026-11-02T14:33:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-718631389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=726a609f-d8c6-4176-9a8b-90d97fb34aa7,host='devstack@QuobyteHD#QuobyteHD',id=7a7523af-90db-42f4-9983-295bdb6ecce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ed7fdcc9b27430eb64ddc345eb07dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:33:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:33:51Z,use_quota=True,user_id='4ccffc91cd794118934d9b43284640aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1397418f-37fd-4a62-8894-94d124423f98),volume_type_id=1397418f-37fd-4a62-8894-94d124423f98)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:33:51 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] Creating volume 7a7523af-90db-42f4-9983-295bdb6ecce6 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:33:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:33:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:33:51 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:33:51 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:33:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:33:51 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:33:51 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:33:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7a7523af-90db-42f4-9983-295bdb6ecce6 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:51 devstack sudo[94178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7a7523af-90db-42f4-9983-295bdb6ecce6 1073741824 Nov 02 15:33:51 devstack sudo[94178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:51 devstack sudo[94178]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7a7523af-90db-42f4-9983-295bdb6ecce6 1073741824" returned: 0 in 0.619s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7a7523af-90db-42f4-9983-295bdb6ecce6 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:52 devstack sudo[94183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7a7523af-90db-42f4-9983-295bdb6ecce6 Nov 02 15:33:52 devstack sudo[94183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:52 devstack sudo[94183]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7a7523af-90db-42f4-9983-295bdb6ecce6" returned: 0 in 0.361s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:52 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:33:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:33:52 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9619ab29-a55e-48eb-870e-2eedd6d81b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a7523af-90db-42f4-9983-295bdb6ecce6', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:52 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b3ee7b2-a469-4b8c-a903-4279a70e8ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:52 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] Volume volume-7a7523af-90db-42f4-9983-295bdb6ecce6 (7a7523af-90db-42f4-9983-295bdb6ecce6): created successfully Nov 02 15:33:52 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b3ee7b2-a469-4b8c-a903-4279a70e8ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:52 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] Flow 'volume_create_manager' (59d18e09-c390-47e2-a96b-2ab1b6b12ee3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:33:52 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-3086c499-74d4-498b-a898-3b96ebf48012 tempest-GroupsTest-2000442855 None] Created volume successfully. Nov 02 15:33:54 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-392ded77-bc19-48d0-a16e-c2478ab68333 tempest-GroupsTest-2000442855 None] Update group completed successfully. Nov 02 15:33:54 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:33:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] Flow 'volume_create_manager' (c6754514-457c-4c11-a7ca-b20c6b3354c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:33:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c5b5c4e-3702-49cf-900e-967e919d0da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c5b5c4e-3702-49cf-900e-967e919d0da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-556767026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=248da0aa-5530-46da-973b-8ab357820442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae0b20db774f4d3cb4b73e96bc29f535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:33:54Z,use_quota=True,user_id='ab199a18e3b84fc88b776ebbddee74de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9da662-6d70-4a1e-9c08-0c05adc5c01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9da662-6d70-4a1e-9c08-0c05adc5c01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10f49804-a7fc-45b2-aece-2bc17baa41b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10f49804-a7fc-45b2-aece-2bc17baa41b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '248da0aa-5530-46da-973b-8ab357820442', 'volume_name': 'volume-248da0aa-5530-46da-973b-8ab357820442', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced8bd57-c2a9-4a8d-ab27-e72a881af589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced8bd57-c2a9-4a8d-ab27-e72a881af589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f68de688-d3ff-4d8b-ac34-ac4745103661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:54 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] Volume 248da0aa-5530-46da-973b-8ab357820442: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-248da0aa-5530-46da-973b-8ab357820442', 'volume_size': 1} Nov 02 15:33:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:33:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:33:54 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:33:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-556767026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=248da0aa-5530-46da-973b-8ab357820442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae0b20db774f4d3cb4b73e96bc29f535',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:33:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:33:54Z,use_quota=True,user_id='ab199a18e3b84fc88b776ebbddee74de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:33:54 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] Creating volume 248da0aa-5530-46da-973b-8ab357820442 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:33:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:33:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:33:54 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:33:54 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:33:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:33:54 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:33:54 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:33:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-248da0aa-5530-46da-973b-8ab357820442 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:54 devstack sudo[94201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-248da0aa-5530-46da-973b-8ab357820442 1073741824 Nov 02 15:33:54 devstack sudo[94201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:54 devstack sudo[94201]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-248da0aa-5530-46da-973b-8ab357820442 1073741824" returned: 0 in 0.495s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-248da0aa-5530-46da-973b-8ab357820442 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:54 devstack sudo[94208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-248da0aa-5530-46da-973b-8ab357820442 Nov 02 15:33:54 devstack sudo[94208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:55 devstack sudo[94208]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-248da0aa-5530-46da-973b-8ab357820442" returned: 0 in 0.289s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:55 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:33:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:33:55 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f68de688-d3ff-4d8b-ac34-ac4745103661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-248da0aa-5530-46da-973b-8ab357820442', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:55 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32105007-3976-4611-8dfe-e3ee2b1fa3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:33:55 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] Volume volume-248da0aa-5530-46da-973b-8ab357820442 (248da0aa-5530-46da-973b-8ab357820442): created successfully Nov 02 15:33:55 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32105007-3976-4611-8dfe-e3ee2b1fa3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:33:55 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] Flow 'volume_create_manager' (c6754514-457c-4c11-a7ca-b20c6b3354c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:33:55 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-ea2e5a40-d2c4-4566-9c25-f40cf541beb1 tempest-VolumesNegativeTest-2046224811 None] Created volume successfully. Nov 02 15:33:55 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-7eafebeb-207c-4d9c-ab3e-45d57b2ce6f1 tempest-GroupsTest-2000442855 None] Update group completed successfully. Nov 02 15:33:57 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-75810d7f-9954-4aff-b260-7e1e393cae66 tempest-GroupsTest-2000442855 None] Acquiring lock "cinder-quobyte-7a7523af-90db-42f4-9983-295bdb6ecce6" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:33:57 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-75810d7f-9954-4aff-b260-7e1e393cae66 tempest-GroupsTest-2000442855 None] Lock "cinder-quobyte-7a7523af-90db-42f4-9983-295bdb6ecce6" acquired by "delete_volume" :: waited 0.026s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:33:57 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[260bbbb2-9b85-4321-9b21-2b087fa4e033]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:33:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-75810d7f-9954-4aff-b260-7e1e393cae66 tempest-GroupsTest-2000442855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7a7523af-90db-42f4-9983-295bdb6ecce6 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:58 devstack sudo[94279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7a7523af-90db-42f4-9983-295bdb6ecce6 Nov 02 15:33:58 devstack sudo[94279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:58 devstack sudo[94279]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-75810d7f-9954-4aff-b260-7e1e393cae66 tempest-GroupsTest-2000442855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7a7523af-90db-42f4-9983-295bdb6ecce6" returned: 0 in 0.686s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-75810d7f-9954-4aff-b260-7e1e393cae66 tempest-GroupsTest-2000442855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7a7523af-90db-42f4-9983-295bdb6ecce6 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:58 devstack sudo[94289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7a7523af-90db-42f4-9983-295bdb6ecce6 Nov 02 15:33:58 devstack sudo[94289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:59 devstack sudo[94289]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-75810d7f-9954-4aff-b260-7e1e393cae66 tempest-GroupsTest-2000442855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7a7523af-90db-42f4-9983-295bdb6ecce6" returned: 0 in 0.515s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:59 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-75810d7f-9954-4aff-b260-7e1e393cae66 tempest-GroupsTest-2000442855 None] Lock "cinder-quobyte-7a7523af-90db-42f4-9983-295bdb6ecce6" released by "delete_volume" :: held 1.281s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:33:59 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-75810d7f-9954-4aff-b260-7e1e393cae66 tempest-GroupsTest-2000442855 None] Acquiring lock "cinder-quobyte-aa3fc952-e457-4488-b161-f831dbee6351" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:33:59 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-75810d7f-9954-4aff-b260-7e1e393cae66 tempest-GroupsTest-2000442855 None] Lock "cinder-quobyte-aa3fc952-e457-4488-b161-f831dbee6351" acquired by "delete_volume" :: waited 0.028s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:33:59 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9123040b-3280-46f7-bdea-6d6112446bf5]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:33:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-75810d7f-9954-4aff-b260-7e1e393cae66 tempest-GroupsTest-2000442855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-aa3fc952-e457-4488-b161-f831dbee6351 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:33:59 devstack sudo[94292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-aa3fc952-e457-4488-b161-f831dbee6351 Nov 02 15:33:59 devstack sudo[94292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:33:59 devstack sudo[94292]: pam_unix(sudo:session): session closed for user root Nov 02 15:33:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-75810d7f-9954-4aff-b260-7e1e393cae66 tempest-GroupsTest-2000442855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-aa3fc952-e457-4488-b161-f831dbee6351" returned: 0 in 0.701s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:33:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-75810d7f-9954-4aff-b260-7e1e393cae66 tempest-GroupsTest-2000442855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-aa3fc952-e457-4488-b161-f831dbee6351 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:34:00 devstack sudo[94298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-aa3fc952-e457-4488-b161-f831dbee6351 Nov 02 15:34:00 devstack sudo[94298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:34:00 devstack sudo[94298]: pam_unix(sudo:session): session closed for user root Nov 02 15:34:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-75810d7f-9954-4aff-b260-7e1e393cae66 tempest-GroupsTest-2000442855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-aa3fc952-e457-4488-b161-f831dbee6351" returned: 0 in 0.432s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:34:00 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-75810d7f-9954-4aff-b260-7e1e393cae66 tempest-GroupsTest-2000442855 None] Lock "cinder-quobyte-aa3fc952-e457-4488-b161-f831dbee6351" released by "delete_volume" :: held 1.245s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:34:00 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-75810d7f-9954-4aff-b260-7e1e393cae66 tempest-GroupsTest-2000442855 None] Created reservations ['63e9f4b9-5a95-4874-9603-e282f1610bfc'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:34:00 devstack cinder-volume[86703]: WARNING cinder.quota [None req-75810d7f-9954-4aff-b260-7e1e393cae66 tempest-GroupsTest-2000442855 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-611172054 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-611172054, it is now deprecated. Please use the default quota class for default quota. Nov 02 15:34:00 devstack cinder-volume[86703]: WARNING cinder.quota [None req-75810d7f-9954-4aff-b260-7e1e393cae66 tempest-GroupsTest-2000442855 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-611172054 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-611172054, it is now deprecated. Please use the default quota class for default quota. Nov 02 15:34:00 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-75810d7f-9954-4aff-b260-7e1e393cae66 tempest-GroupsTest-2000442855 None] Created reservations ['4cbfaf14-ec2e-4289-93e7-956f34156ce4', '180b3944-712b-47de-9f61-b5d13e83f7b2', 'd0225a18-e7d8-4821-a916-72bb3ede081c', '6ca8e933-dda1-45eb-abff-2ec17450f865'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:34:01 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-75810d7f-9954-4aff-b260-7e1e393cae66 tempest-GroupsTest-2000442855 None] Created reservations ['7f933677-cab9-4a3c-8c50-a4b4a6c074fb', '29f2283f-a23d-401b-bbe5-1ec049225b17', '9c271fa2-79c1-42d9-b835-20f23c3854a7', 'b749b941-b91c-4c71-8bd3-512979045c38'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:34:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-75810d7f-9954-4aff-b260-7e1e393cae66 tempest-GroupsTest-2000442855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:34:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-75810d7f-9954-4aff-b260-7e1e393cae66 tempest-GroupsTest-2000442855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:34:01 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-75810d7f-9954-4aff-b260-7e1e393cae66 tempest-GroupsTest-2000442855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:34:01 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-75810d7f-9954-4aff-b260-7e1e393cae66 tempest-GroupsTest-2000442855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:34:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-75810d7f-9954-4aff-b260-7e1e393cae66 tempest-GroupsTest-2000442855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:34:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-75810d7f-9954-4aff-b260-7e1e393cae66 tempest-GroupsTest-2000442855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:34:01 devstack sudo[94305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:34:01 devstack sudo[94305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:34:01 devstack sudo[94305]: pam_unix(sudo:session): session closed for user root Nov 02 15:34:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-75810d7f-9954-4aff-b260-7e1e393cae66 tempest-GroupsTest-2000442855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.462s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:34:01 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-75810d7f-9954-4aff-b260-7e1e393cae66 tempest-GroupsTest-2000442855 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:34:01 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-75810d7f-9954-4aff-b260-7e1e393cae66 tempest-GroupsTest-2000442855 None] Delete group completed successfully. Nov 02 15:34:14 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-73009163-6cb4-4827-be32-980879eaa752 tempest-GroupsV320Test-1410497239 None] Group tempest-GroupsV320Test-Group-635393731: creating Nov 02 15:34:14 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-73009163-6cb4-4827-be32-980879eaa752 tempest-GroupsV320Test-1410497239 None] Group tempest-GroupsV320Test-Group-635393731: created successfully Nov 02 15:34:14 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-73009163-6cb4-4827-be32-980879eaa752 tempest-GroupsV320Test-1410497239 None] Create group completed successfully. Nov 02 15:34:17 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-5e29958b-7f13-4a26-badf-8e1fdff37f75 tempest-GroupsV320Test-1410497239 None] Created reservations ['a03da648-d931-4dae-990a-c7f1b39e90f1'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:34:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5e29958b-7f13-4a26-badf-8e1fdff37f75 tempest-GroupsV320Test-1410497239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:34:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5e29958b-7f13-4a26-badf-8e1fdff37f75 tempest-GroupsV320Test-1410497239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:34:17 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-5e29958b-7f13-4a26-badf-8e1fdff37f75 tempest-GroupsV320Test-1410497239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:34:17 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-5e29958b-7f13-4a26-badf-8e1fdff37f75 tempest-GroupsV320Test-1410497239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:34:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5e29958b-7f13-4a26-badf-8e1fdff37f75 tempest-GroupsV320Test-1410497239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:34:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5e29958b-7f13-4a26-badf-8e1fdff37f75 tempest-GroupsV320Test-1410497239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:34:17 devstack sudo[94473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:34:17 devstack sudo[94473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:34:17 devstack sudo[94473]: pam_unix(sudo:session): session closed for user root Nov 02 15:34:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5e29958b-7f13-4a26-badf-8e1fdff37f75 tempest-GroupsV320Test-1410497239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.235s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:34:17 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-5e29958b-7f13-4a26-badf-8e1fdff37f75 tempest-GroupsV320Test-1410497239 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:34:17 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-5e29958b-7f13-4a26-badf-8e1fdff37f75 tempest-GroupsV320Test-1410497239 None] Delete group completed successfully. Nov 02 15:34:20 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:34:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:34:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:34:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:34:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:34:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:34:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:34:20 devstack sudo[94477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:34:20 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:34:21 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root Nov 02 15:34:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.364s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:34:21 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:34:21 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager._thread_info {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:34:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread count: 29 {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 15:34:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread info: [<_MainThread(MainThread, started 125876361756800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 15:34:24 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:34:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] Flow 'volume_create_manager' (bdb20315-a4dc-4b17-a4c3-99f9f537633a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:34:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccef4915-8af9-4696-9cf3-5de4d03b311a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:34:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccef4915-8af9-4696-9cf3-5de4d03b311a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-361486517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d66c5ad7-0747-4aa0-8aab-5653f29c0bbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a129d023d74ae690f617c854ba4c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:34:24Z,use_quota=True,user_id='d9797744c3544776ada81755252e15b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:34:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84122519-5b2f-4f3a-98b8-06744e42e5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:34:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84122519-5b2f-4f3a-98b8-06744e42e5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:34:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ca3c68-0523-4820-8195-8dbc0a2c5fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:34:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ca3c68-0523-4820-8195-8dbc0a2c5fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd66c5ad7-0747-4aa0-8aab-5653f29c0bbe', 'volume_name': 'volume-d66c5ad7-0747-4aa0-8aab-5653f29c0bbe', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:34:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e18a93d2-ad0c-4fcb-b831-07578442f149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:34:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e18a93d2-ad0c-4fcb-b831-07578442f149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:34:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db3adc2-0c1b-4ff1-a045-7a3a3e1735c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:34:24 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] Volume d66c5ad7-0747-4aa0-8aab-5653f29c0bbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d66c5ad7-0747-4aa0-8aab-5653f29c0bbe', 'volume_size': 1} Nov 02 15:34:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:34:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:34:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-361486517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d66c5ad7-0747-4aa0-8aab-5653f29c0bbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a129d023d74ae690f617c854ba4c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:34:24Z,use_quota=True,user_id='d9797744c3544776ada81755252e15b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:34:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] Creating volume d66c5ad7-0747-4aa0-8aab-5653f29c0bbe {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:34:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:34:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:34:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:34:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:34:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:34:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:34:24 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:34:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d66c5ad7-0747-4aa0-8aab-5653f29c0bbe 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:34:24 devstack sudo[94486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d66c5ad7-0747-4aa0-8aab-5653f29c0bbe 1073741824 Nov 02 15:34:24 devstack sudo[94486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:34:25 devstack sudo[94486]: pam_unix(sudo:session): session closed for user root Nov 02 15:34:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d66c5ad7-0747-4aa0-8aab-5653f29c0bbe 1073741824" returned: 0 in 0.708s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:34:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d66c5ad7-0747-4aa0-8aab-5653f29c0bbe {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:34:25 devstack sudo[94501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d66c5ad7-0747-4aa0-8aab-5653f29c0bbe Nov 02 15:34:25 devstack sudo[94501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:34:25 devstack sudo[94501]: pam_unix(sudo:session): session closed for user root Nov 02 15:34:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d66c5ad7-0747-4aa0-8aab-5653f29c0bbe" returned: 0 in 0.363s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:34:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:34:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:34:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3db3adc2-0c1b-4ff1-a045-7a3a3e1735c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d66c5ad7-0747-4aa0-8aab-5653f29c0bbe', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:34:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fdf2140-2f75-43e6-8bed-e1eccbb78fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:34:25 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] Volume volume-d66c5ad7-0747-4aa0-8aab-5653f29c0bbe (d66c5ad7-0747-4aa0-8aab-5653f29c0bbe): created successfully Nov 02 15:34:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fdf2140-2f75-43e6-8bed-e1eccbb78fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:34:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] Flow 'volume_create_manager' (bdb20315-a4dc-4b17-a4c3-99f9f537633a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:34:25 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-c05bc9b3-4ef8-42dd-986e-b0acd37feeda tempest-AttachVolumeNegativeTest-1941915072 None] Created volume successfully. Nov 02 15:34:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-67d5c2a5-7e42-477b-a6ad-fa8a547b7344 req-4c6c20fe-2c49-477d-863b-35a6da0f9f94 tempest-AttachVolumeNegativeTest-1941915072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:34:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-67d5c2a5-7e42-477b-a6ad-fa8a547b7344 req-4c6c20fe-2c49-477d-863b-35a6da0f9f94 tempest-AttachVolumeNegativeTest-1941915072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:34:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-67d5c2a5-7e42-477b-a6ad-fa8a547b7344 req-4c6c20fe-2c49-477d-863b-35a6da0f9f94 tempest-AttachVolumeNegativeTest-1941915072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.047s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:34:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-67d5c2a5-7e42-477b-a6ad-fa8a547b7344 req-4c6c20fe-2c49-477d-863b-35a6da0f9f94 tempest-AttachVolumeNegativeTest-1941915072 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478', 'name': 'volume-d66c5ad7-0747-4aa0-8aab-5653f29c0bbe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3832d1bb-38fd-41cb-9b2a-97c70b5e5341', 'enforce_multipath': True} {{(pid=86703) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 15:34:28 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-67d5c2a5-7e42-477b-a6ad-fa8a547b7344 req-4c6c20fe-2c49-477d-863b-35a6da0f9f94 tempest-AttachVolumeNegativeTest-1941915072 None] attachment_update completed successfully. Nov 02 15:34:30 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ad833ed4-c63e-44db-8d08-b30a27d86589 tempest-VolumesNegativeTest-2046224811 None] Acquiring lock "cinder-248da0aa-5530-46da-973b-8ab357820442-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:34:30 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ad833ed4-c63e-44db-8d08-b30a27d86589 tempest-VolumesNegativeTest-2046224811 None] Lock "cinder-248da0aa-5530-46da-973b-8ab357820442-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:34:30 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:UPDATE=105,cinder:SELECT=97,cinder:INSERT=20,cinder:DELETE=3 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:34:30 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:UPDATE=103,cinder:SELECT=79,cinder:INSERT=23,cinder:DELETE=9 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:34:30 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ad833ed4-c63e-44db-8d08-b30a27d86589 tempest-VolumesNegativeTest-2046224811 None] Acquiring lock "cinder-quobyte-248da0aa-5530-46da-973b-8ab357820442" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:34:30 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ad833ed4-c63e-44db-8d08-b30a27d86589 tempest-VolumesNegativeTest-2046224811 None] Lock "cinder-quobyte-248da0aa-5530-46da-973b-8ab357820442" acquired by "delete_volume" :: waited 0.035s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:34:31 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8523b283-d1b4-4a7b-965f-0258ad774414]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:34:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ad833ed4-c63e-44db-8d08-b30a27d86589 tempest-VolumesNegativeTest-2046224811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-248da0aa-5530-46da-973b-8ab357820442 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:34:31 devstack sudo[95006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-248da0aa-5530-46da-973b-8ab357820442 Nov 02 15:34:31 devstack sudo[95006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:34:31 devstack sudo[95006]: pam_unix(sudo:session): session closed for user root Nov 02 15:34:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ad833ed4-c63e-44db-8d08-b30a27d86589 tempest-VolumesNegativeTest-2046224811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-248da0aa-5530-46da-973b-8ab357820442" returned: 0 in 0.521s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:34:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ad833ed4-c63e-44db-8d08-b30a27d86589 tempest-VolumesNegativeTest-2046224811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-248da0aa-5530-46da-973b-8ab357820442 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:34:31 devstack sudo[95011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-248da0aa-5530-46da-973b-8ab357820442 Nov 02 15:34:31 devstack sudo[95011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:34:32 devstack sudo[95011]: pam_unix(sudo:session): session closed for user root Nov 02 15:34:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ad833ed4-c63e-44db-8d08-b30a27d86589 tempest-VolumesNegativeTest-2046224811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-248da0aa-5530-46da-973b-8ab357820442" returned: 0 in 0.479s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:34:32 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ad833ed4-c63e-44db-8d08-b30a27d86589 tempest-VolumesNegativeTest-2046224811 None] Lock "cinder-quobyte-248da0aa-5530-46da-973b-8ab357820442" released by "delete_volume" :: held 1.085s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:34:32 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-ad833ed4-c63e-44db-8d08-b30a27d86589 tempest-VolumesNegativeTest-2046224811 None] Created reservations ['3b62807b-cc65-44d3-b8cf-a4df833f9e22', '52e45a57-175c-4c02-9a8f-26d3fb7ff29b', 'fbfb5b5a-7917-43ff-8f34-6486ebd67a04', '0ed95b4a-c405-4f27-8b0e-8f6c36fe929a'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:34:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ad833ed4-c63e-44db-8d08-b30a27d86589 tempest-VolumesNegativeTest-2046224811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:34:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ad833ed4-c63e-44db-8d08-b30a27d86589 tempest-VolumesNegativeTest-2046224811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:34:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ad833ed4-c63e-44db-8d08-b30a27d86589 tempest-VolumesNegativeTest-2046224811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:34:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ad833ed4-c63e-44db-8d08-b30a27d86589 tempest-VolumesNegativeTest-2046224811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:34:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ad833ed4-c63e-44db-8d08-b30a27d86589 tempest-VolumesNegativeTest-2046224811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:34:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ad833ed4-c63e-44db-8d08-b30a27d86589 tempest-VolumesNegativeTest-2046224811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:34:32 devstack sudo[95014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:34:32 devstack sudo[95014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:34:32 devstack sudo[95014]: pam_unix(sudo:session): session closed for user root Nov 02 15:34:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ad833ed4-c63e-44db-8d08-b30a27d86589 tempest-VolumesNegativeTest-2046224811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.317s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:34:32 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-ad833ed4-c63e-44db-8d08-b30a27d86589 tempest-VolumesNegativeTest-2046224811 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:34:32 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-ad833ed4-c63e-44db-8d08-b30a27d86589 tempest-VolumesNegativeTest-2046224811 None] Deleted volume successfully. Nov 02 15:34:32 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ad833ed4-c63e-44db-8d08-b30a27d86589 tempest-VolumesNegativeTest-2046224811 None] Lock "cinder-248da0aa-5530-46da-973b-8ab357820442-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:34:41 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:34:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] Flow 'volume_create_manager' (bf429402-4c2e-478c-86f5-63a6641af27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:34:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a585d07-e697-4dc6-bb2a-4efd84eb0e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:34:42 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a585d07-e697-4dc6-bb2a-4efd84eb0e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-967404622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f6ed393-cfbe-4e8c-88c6-84f8bde39d35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='133936168291420cbcc2f07bd8affc7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:34:42Z,use_quota=True,user_id='60ad750e593d4ff2b53392c0944947b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:34:42 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (762506d6-ccab-42ee-82df-e079e8d6e729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:34:42 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (762506d6-ccab-42ee-82df-e079e8d6e729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:34:42 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db8c1d7b-b1a7-46b1-9070-78773a511924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:34:42 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db8c1d7b-b1a7-46b1-9070-78773a511924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f6ed393-cfbe-4e8c-88c6-84f8bde39d35', 'volume_name': 'volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:34:42 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3020b5d6-dd10-4eda-ac76-7f9281d2672e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:34:42 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3020b5d6-dd10-4eda-ac76-7f9281d2672e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:34:42 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64006d9e-5dd7-43cb-8c85-f50293ab869d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:34:42 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] Volume 6f6ed393-cfbe-4e8c-88c6-84f8bde39d35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35', 'volume_size': 1} Nov 02 15:34:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:34:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:34:42 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-967404622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f6ed393-cfbe-4e8c-88c6-84f8bde39d35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='133936168291420cbcc2f07bd8affc7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:34:42Z,use_quota=True,user_id='60ad750e593d4ff2b53392c0944947b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:34:42 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] Creating volume 6f6ed393-cfbe-4e8c-88c6-84f8bde39d35 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:34:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:34:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:34:42 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:34:42 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:34:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:34:42 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:34:42 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:34:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:34:42 devstack sudo[95056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35 1073741824 Nov 02 15:34:42 devstack sudo[95056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:34:42 devstack sudo[95056]: pam_unix(sudo:session): session closed for user root Nov 02 15:34:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35 1073741824" returned: 0 in 0.827s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:34:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:34:43 devstack sudo[95063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35 Nov 02 15:34:43 devstack sudo[95063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:34:43 devstack sudo[95063]: pam_unix(sudo:session): session closed for user root Nov 02 15:34:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35" returned: 0 in 0.432s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:34:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:34:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:34:43 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64006d9e-5dd7-43cb-8c85-f50293ab869d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:34:43 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0747128-86ec-4481-a5e7-c5189f84213b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:34:43 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] Volume volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35 (6f6ed393-cfbe-4e8c-88c6-84f8bde39d35): created successfully Nov 02 15:34:43 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0747128-86ec-4481-a5e7-c5189f84213b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:34:43 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] Flow 'volume_create_manager' (bf429402-4c2e-478c-86f5-63a6641af27d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:34:43 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-a06389a0-93e1-4946-8543-00de738091e9 tempest-VolumesSnapshotListTestJSON-314053805 None] Created volume successfully. Nov 02 15:34:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a548c4a1-b945-49b0-8947-0eb4c008a86b tempest-VolumesSnapshotListTestJSON-314053805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:34:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a548c4a1-b945-49b0-8947-0eb4c008a86b tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:34:44 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-a548c4a1-b945-49b0-8947-0eb4c008a86b tempest-VolumesSnapshotListTestJSON-314053805 None] Creating offline snapshot c2092838-084f-4129-94a9-27d502989012 of volume 6f6ed393-cfbe-4e8c-88c6-84f8bde39d35 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:34:44 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[16630ab6-f922-43a8-bcda-f8c0b7740e45]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:34:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a548c4a1-b945-49b0-8947-0eb4c008a86b tempest-VolumesSnapshotListTestJSON-314053805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:34:44 devstack sudo[95099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35 Nov 02 15:34:44 devstack sudo[95099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:34:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a548c4a1-b945-49b0-8947-0eb4c008a86b tempest-VolumesSnapshotListTestJSON-314053805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35" returned: 0 in 0.647s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:34:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a548c4a1-b945-49b0-8947-0eb4c008a86b tempest-VolumesSnapshotListTestJSON-314053805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.c2092838-084f-4129-94a9-27d502989012 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:34:45 devstack sudo[95099]: pam_unix(sudo:session): session closed for user root Nov 02 15:34:45 devstack sudo[95144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.c2092838-084f-4129-94a9-27d502989012 1G Nov 02 15:34:45 devstack sudo[95144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:34:45 devstack sudo[95144]: pam_unix(sudo:session): session closed for user root Nov 02 15:34:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a548c4a1-b945-49b0-8947-0eb4c008a86b tempest-VolumesSnapshotListTestJSON-314053805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.c2092838-084f-4129-94a9-27d502989012 1G" returned: 0 in 0.688s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:34:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a548c4a1-b945-49b0-8947-0eb4c008a86b tempest-VolumesSnapshotListTestJSON-314053805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.c2092838-084f-4129-94a9-27d502989012 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:34:45 devstack sudo[95179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.c2092838-084f-4129-94a9-27d502989012 Nov 02 15:34:45 devstack sudo[95179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:34:46 devstack sudo[95179]: pam_unix(sudo:session): session closed for user root Nov 02 15:34:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a548c4a1-b945-49b0-8947-0eb4c008a86b tempest-VolumesSnapshotListTestJSON-314053805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.c2092838-084f-4129-94a9-27d502989012" returned: 0 in 0.306s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:34:46 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-a548c4a1-b945-49b0-8947-0eb4c008a86b tempest-VolumesSnapshotListTestJSON-314053805 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.c2092838-084f-4129-94a9-27d502989012 is being set with open permissions: ugo+rw Nov 02 15:34:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a548c4a1-b945-49b0-8947-0eb4c008a86b tempest-VolumesSnapshotListTestJSON-314053805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.c2092838-084f-4129-94a9-27d502989012 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:34:46 devstack sudo[95192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.c2092838-084f-4129-94a9-27d502989012 Nov 02 15:34:46 devstack sudo[95192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:34:46 devstack sudo[95192]: pam_unix(sudo:session): session closed for user root Nov 02 15:34:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a548c4a1-b945-49b0-8947-0eb4c008a86b tempest-VolumesSnapshotListTestJSON-314053805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.c2092838-084f-4129-94a9-27d502989012" returned: 0 in 0.257s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:34:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a548c4a1-b945-49b0-8947-0eb4c008a86b tempest-VolumesSnapshotListTestJSON-314053805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:34:49 devstack sudo[95221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.info Nov 02 15:34:49 devstack sudo[95221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:34:49 devstack sudo[95221]: pam_unix(sudo:session): session closed for user root Nov 02 15:34:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a548c4a1-b945-49b0-8947-0eb4c008a86b tempest-VolumesSnapshotListTestJSON-314053805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.info" returned: 0 in 0.457s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:34:49 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-a548c4a1-b945-49b0-8947-0eb4c008a86b tempest-VolumesSnapshotListTestJSON-314053805 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.info is being set with open permissions: ugo+rw Nov 02 15:34:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a548c4a1-b945-49b0-8947-0eb4c008a86b tempest-VolumesSnapshotListTestJSON-314053805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:34:50 devstack sudo[95236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.info Nov 02 15:34:50 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:34:50 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root Nov 02 15:34:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a548c4a1-b945-49b0-8947-0eb4c008a86b tempest-VolumesSnapshotListTestJSON-314053805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.info" returned: 0 in 0.565s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:34:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a548c4a1-b945-49b0-8947-0eb4c008a86b tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.199s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:34:50 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-a548c4a1-b945-49b0-8947-0eb4c008a86b tempest-VolumesSnapshotListTestJSON-314053805 None] Create snapshot completed successfully Nov 02 15:34:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-feb55110-4bba-44de-a50c-f78beb33af67 tempest-VolumesSnapshotListTestJSON-314053805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:34:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-feb55110-4bba-44de-a50c-f78beb33af67 tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:34:52 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-feb55110-4bba-44de-a50c-f78beb33af67 tempest-VolumesSnapshotListTestJSON-314053805 None] Creating offline snapshot 4046c897-eee5-48e0-a1fe-6caacf43afa1 of volume 6f6ed393-cfbe-4e8c-88c6-84f8bde39d35 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:34:52 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ee65f4-736d-4f25-bb98-4a6de3590b88]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:34:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-feb55110-4bba-44de-a50c-f78beb33af67 tempest-VolumesSnapshotListTestJSON-314053805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.c2092838-084f-4129-94a9-27d502989012 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:34:52 devstack sudo[95267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.c2092838-084f-4129-94a9-27d502989012 Nov 02 15:34:52 devstack sudo[95267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:34:53 devstack sudo[95267]: pam_unix(sudo:session): session closed for user root Nov 02 15:34:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-feb55110-4bba-44de-a50c-f78beb33af67 tempest-VolumesSnapshotListTestJSON-314053805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.c2092838-084f-4129-94a9-27d502989012" returned: 0 in 1.145s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:34:53 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-feb55110-4bba-44de-a50c-f78beb33af67 tempest-VolumesSnapshotListTestJSON-314053805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:34:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-feb55110-4bba-44de-a50c-f78beb33af67 tempest-VolumesSnapshotListTestJSON-314053805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.c2092838-084f-4129-94a9-27d502989012,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.4046c897-eee5-48e0-a1fe-6caacf43afa1 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:34:53 devstack sudo[95294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.c2092838-084f-4129-94a9-27d502989012,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.4046c897-eee5-48e0-a1fe-6caacf43afa1 1G Nov 02 15:34:53 devstack sudo[95294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:34:55 devstack sudo[95294]: pam_unix(sudo:session): session closed for user root Nov 02 15:34:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-feb55110-4bba-44de-a50c-f78beb33af67 tempest-VolumesSnapshotListTestJSON-314053805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.c2092838-084f-4129-94a9-27d502989012,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.4046c897-eee5-48e0-a1fe-6caacf43afa1 1G" returned: 0 in 1.298s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:34:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-feb55110-4bba-44de-a50c-f78beb33af67 tempest-VolumesSnapshotListTestJSON-314053805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.c2092838-084f-4129-94a9-27d502989012 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.4046c897-eee5-48e0-a1fe-6caacf43afa1 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:34:55 devstack sudo[95300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.c2092838-084f-4129-94a9-27d502989012 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.4046c897-eee5-48e0-a1fe-6caacf43afa1 Nov 02 15:34:55 devstack sudo[95300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:34:55 devstack sudo[95300]: pam_unix(sudo:session): session closed for user root Nov 02 15:34:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-feb55110-4bba-44de-a50c-f78beb33af67 tempest-VolumesSnapshotListTestJSON-314053805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.c2092838-084f-4129-94a9-27d502989012 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.4046c897-eee5-48e0-a1fe-6caacf43afa1" returned: 0 in 0.587s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:34:55 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-feb55110-4bba-44de-a50c-f78beb33af67 tempest-VolumesSnapshotListTestJSON-314053805 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.4046c897-eee5-48e0-a1fe-6caacf43afa1 is being set with open permissions: ugo+rw Nov 02 15:34:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-feb55110-4bba-44de-a50c-f78beb33af67 tempest-VolumesSnapshotListTestJSON-314053805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.4046c897-eee5-48e0-a1fe-6caacf43afa1 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:34:55 devstack sudo[95307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.4046c897-eee5-48e0-a1fe-6caacf43afa1 Nov 02 15:34:55 devstack sudo[95307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:34:56 devstack sudo[95307]: pam_unix(sudo:session): session closed for user root Nov 02 15:34:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-feb55110-4bba-44de-a50c-f78beb33af67 tempest-VolumesSnapshotListTestJSON-314053805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.4046c897-eee5-48e0-a1fe-6caacf43afa1" returned: 0 in 0.472s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:34:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-feb55110-4bba-44de-a50c-f78beb33af67 tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.866s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:34:56 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-feb55110-4bba-44de-a50c-f78beb33af67 tempest-VolumesSnapshotListTestJSON-314053805 None] Create snapshot completed successfully Nov 02 15:34:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-20082ccc-711c-4ff8-9cb8-a6c9527729e6 tempest-VolumesSnapshotListTestJSON-314053805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:34:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-20082ccc-711c-4ff8-9cb8-a6c9527729e6 tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:34:56 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-20082ccc-711c-4ff8-9cb8-a6c9527729e6 tempest-VolumesSnapshotListTestJSON-314053805 None] Creating offline snapshot 3cb12caa-49b8-46f7-8884-3d894a77a4cf of volume 6f6ed393-cfbe-4e8c-88c6-84f8bde39d35 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:34:57 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa5cf37-e2ba-40b1-b6e9-fb378be88813]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:34:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-20082ccc-711c-4ff8-9cb8-a6c9527729e6 tempest-VolumesSnapshotListTestJSON-314053805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.4046c897-eee5-48e0-a1fe-6caacf43afa1 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:34:57 devstack sudo[95312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.4046c897-eee5-48e0-a1fe-6caacf43afa1 Nov 02 15:34:57 devstack sudo[95312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:34:57 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:34:57 devstack sudo[95312]: pam_unix(sudo:session): session closed for user root Nov 02 15:34:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] Flow 'volume_create_manager' (79696b4a-4282-4ee4-a6e4-c8832a23abbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:34:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cedd0e40-6d2a-4b50-92cc-5af2dc02f6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:34:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-20082ccc-711c-4ff8-9cb8-a6c9527729e6 tempest-VolumesSnapshotListTestJSON-314053805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.4046c897-eee5-48e0-a1fe-6caacf43afa1" returned: 0 in 0.686s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:34:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-20082ccc-711c-4ff8-9cb8-a6c9527729e6 tempest-VolumesSnapshotListTestJSON-314053805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:34:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-20082ccc-711c-4ff8-9cb8-a6c9527729e6 tempest-VolumesSnapshotListTestJSON-314053805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.4046c897-eee5-48e0-a1fe-6caacf43afa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.3cb12caa-49b8-46f7-8884-3d894a77a4cf 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:34:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cedd0e40-6d2a-4b50-92cc-5af2dc02f6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1955810488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5277a25f-f853-462d-9a8a-fbebe0960444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ce89db8649f44ddacd09ab9f16fbff5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:34:58Z,use_quota=True,user_id='9d7b0bd322c247eab7a4a986da508d91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:34:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58bdf94d-71b5-4698-ac14-5dbee28c1984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:34:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58bdf94d-71b5-4698-ac14-5dbee28c1984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:34:57 devstack sudo[95317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.4046c897-eee5-48e0-a1fe-6caacf43afa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.3cb12caa-49b8-46f7-8884-3d894a77a4cf 1G Nov 02 15:34:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d77963c-38d1-4810-a702-04ff354a725a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:34:57 devstack sudo[95317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:34:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d77963c-38d1-4810-a702-04ff354a725a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5277a25f-f853-462d-9a8a-fbebe0960444', 'volume_name': 'volume-5277a25f-f853-462d-9a8a-fbebe0960444', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:34:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb0d3e7-9d9d-4cd1-b391-ac1b4962e46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:34:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eb0d3e7-9d9d-4cd1-b391-ac1b4962e46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:34:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98f0054-e63a-4ae0-a371-217e42c5ed97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:34:57 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] Volume 5277a25f-f853-462d-9a8a-fbebe0960444: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5277a25f-f853-462d-9a8a-fbebe0960444', 'volume_size': 1} Nov 02 15:34:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:34:58 devstack sudo[95317]: pam_unix(sudo:session): session closed for user root Nov 02 15:34:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-20082ccc-711c-4ff8-9cb8-a6c9527729e6 tempest-VolumesSnapshotListTestJSON-314053805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.4046c897-eee5-48e0-a1fe-6caacf43afa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.3cb12caa-49b8-46f7-8884-3d894a77a4cf 1G" returned: 0 in 0.720s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:34:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-20082ccc-711c-4ff8-9cb8-a6c9527729e6 tempest-VolumesSnapshotListTestJSON-314053805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.4046c897-eee5-48e0-a1fe-6caacf43afa1 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.3cb12caa-49b8-46f7-8884-3d894a77a4cf {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:34:58 devstack sudo[95323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.4046c897-eee5-48e0-a1fe-6caacf43afa1 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.3cb12caa-49b8-46f7-8884-3d894a77a4cf Nov 02 15:34:58 devstack sudo[95323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:34:58 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:34:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] Flow 'volume_create_manager' (e3652f7b-bdad-4daf-83a0-5cffef664d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:34:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b393a590-e827-4aba-8f6f-ef37d2cde643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:34:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b393a590-e827-4aba-8f6f-ef37d2cde643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1452116885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cffa5db-01ad-4fe1-bd6d-63115560674c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b042000328647519bf13fe5c9879ccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:34:59Z,use_quota=True,user_id='3f750d5fd8634d30a2f0caa26d00890c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:34:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec247c1c-ed49-4cbd-af7b-c98892941d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:34:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec247c1c-ed49-4cbd-af7b-c98892941d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:34:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66c71132-6508-47f3-9761-7d32c018ec65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:34:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66c71132-6508-47f3-9761-7d32c018ec65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cffa5db-01ad-4fe1-bd6d-63115560674c', 'volume_name': 'volume-8cffa5db-01ad-4fe1-bd6d-63115560674c', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:34:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb1dfbe-5aba-4fb1-b936-ca26f3a392fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:34:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bb1dfbe-5aba-4fb1-b936-ca26f3a392fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:34:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46c334d-4d1e-4375-a1dd-b65af13f7003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:34:58 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] Volume 8cffa5db-01ad-4fe1-bd6d-63115560674c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cffa5db-01ad-4fe1-bd6d-63115560674c', 'volume_size': 1} Nov 02 15:34:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:34:58 devstack sudo[95323]: pam_unix(sudo:session): session closed for user root Nov 02 15:34:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-20082ccc-711c-4ff8-9cb8-a6c9527729e6 tempest-VolumesSnapshotListTestJSON-314053805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.4046c897-eee5-48e0-a1fe-6caacf43afa1 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.3cb12caa-49b8-46f7-8884-3d894a77a4cf" returned: 0 in 0.458s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:34:58 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-20082ccc-711c-4ff8-9cb8-a6c9527729e6 tempest-VolumesSnapshotListTestJSON-314053805 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.3cb12caa-49b8-46f7-8884-3d894a77a4cf is being set with open permissions: ugo+rw Nov 02 15:34:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-20082ccc-711c-4ff8-9cb8-a6c9527729e6 tempest-VolumesSnapshotListTestJSON-314053805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.3cb12caa-49b8-46f7-8884-3d894a77a4cf {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:34:58 devstack sudo[95328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.3cb12caa-49b8-46f7-8884-3d894a77a4cf Nov 02 15:34:58 devstack sudo[95328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:34:59 devstack sudo[95328]: pam_unix(sudo:session): session closed for user root Nov 02 15:34:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-20082ccc-711c-4ff8-9cb8-a6c9527729e6 tempest-VolumesSnapshotListTestJSON-314053805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.3cb12caa-49b8-46f7-8884-3d894a77a4cf" returned: 0 in 0.250s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:34:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-20082ccc-711c-4ff8-9cb8-a6c9527729e6 tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.252s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:34:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.392s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:34:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1955810488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5277a25f-f853-462d-9a8a-fbebe0960444,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ce89db8649f44ddacd09ab9f16fbff5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:34:58Z,use_quota=True,user_id='9d7b0bd322c247eab7a4a986da508d91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:34:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] Creating volume 5277a25f-f853-462d-9a8a-fbebe0960444 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:34:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:34:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:34:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:34:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:34:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:34:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:34:59 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:34:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5277a25f-f853-462d-9a8a-fbebe0960444 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:34:59 devstack sudo[95331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5277a25f-f853-462d-9a8a-fbebe0960444 1073741824 Nov 02 15:34:59 devstack sudo[95331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:34:59 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-20082ccc-711c-4ff8-9cb8-a6c9527729e6 tempest-VolumesSnapshotListTestJSON-314053805 None] Create snapshot completed successfully Nov 02 15:34:59 devstack sudo[95331]: pam_unix(sudo:session): session closed for user root Nov 02 15:34:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5277a25f-f853-462d-9a8a-fbebe0960444 1073741824" returned: 0 in 0.469s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:34:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5277a25f-f853-462d-9a8a-fbebe0960444 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:34:59 devstack sudo[95336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5277a25f-f853-462d-9a8a-fbebe0960444 Nov 02 15:34:59 devstack sudo[95336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:34:59 devstack sudo[95336]: pam_unix(sudo:session): session closed for user root Nov 02 15:34:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5277a25f-f853-462d-9a8a-fbebe0960444" returned: 0 in 0.246s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:34:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:34:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:34:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.108s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:34:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1452116885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cffa5db-01ad-4fe1-bd6d-63115560674c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b042000328647519bf13fe5c9879ccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:34:59Z,use_quota=True,user_id='3f750d5fd8634d30a2f0caa26d00890c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:34:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] Creating volume 8cffa5db-01ad-4fe1-bd6d-63115560674c {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:34:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:34:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:34:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:35:00 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:35:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:35:00 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:35:00 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:35:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8cffa5db-01ad-4fe1-bd6d-63115560674c 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98f0054-e63a-4ae0-a371-217e42c5ed97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5277a25f-f853-462d-9a8a-fbebe0960444', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:35:00 devstack sudo[95339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8cffa5db-01ad-4fe1-bd6d-63115560674c 1073741824 Nov 02 15:35:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05724cbd-c93a-42d5-bb54-fc6dcf112dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:35:00 devstack sudo[95339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:00 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] Volume volume-5277a25f-f853-462d-9a8a-fbebe0960444 (5277a25f-f853-462d-9a8a-fbebe0960444): created successfully Nov 02 15:35:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05724cbd-c93a-42d5-bb54-fc6dcf112dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:35:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] Flow 'volume_create_manager' (79696b4a-4282-4ee4-a6e4-c8832a23abbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:35:00 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-dba60f76-474f-41f9-9696-298bec1e17d7 tempest-ServersNegativeTestJSON-492225478 None] Created volume successfully. Nov 02 15:35:00 devstack sudo[95339]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8cffa5db-01ad-4fe1-bd6d-63115560674c 1073741824" returned: 0 in 0.488s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8cffa5db-01ad-4fe1-bd6d-63115560674c {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:00 devstack sudo[95345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8cffa5db-01ad-4fe1-bd6d-63115560674c Nov 02 15:35:00 devstack sudo[95345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:00 devstack sudo[95345]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8cffa5db-01ad-4fe1-bd6d-63115560674c" returned: 0 in 0.347s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:00 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:35:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:35:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46c334d-4d1e-4375-a1dd-b65af13f7003) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cffa5db-01ad-4fe1-bd6d-63115560674c', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:35:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482f0417-1528-4b56-877a-ca7b9da8ed5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:35:00 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] Volume volume-8cffa5db-01ad-4fe1-bd6d-63115560674c (8cffa5db-01ad-4fe1-bd6d-63115560674c): created successfully Nov 02 15:35:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482f0417-1528-4b56-877a-ca7b9da8ed5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:35:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] Flow 'volume_create_manager' (e3652f7b-bdad-4daf-83a0-5cffef664d65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:35:00 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-dba7039c-3e0f-42c4-95c6-2cc2bfb62ae2 tempest-VolumeQuotasAdminTestJSON-332344472 None] Created volume successfully. Nov 02 15:35:01 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-2e4fcf8a-b693-44b5-bab5-947a712e2cdb tempest-VolumesSnapshotListTestJSON-314053805 None] Acquiring lock "cinder-3cb12caa-49b8-46f7-8884-3d894a77a4cf-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:35:01 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-2e4fcf8a-b693-44b5-bab5-947a712e2cdb tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "cinder-3cb12caa-49b8-46f7-8884-3d894a77a4cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:35:01 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-2e4fcf8a-b693-44b5-bab5-947a712e2cdb tempest-VolumesSnapshotListTestJSON-314053805 None] Acquiring lock "cinder-quobyte-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:35:01 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-2e4fcf8a-b693-44b5-bab5-947a712e2cdb tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "cinder-quobyte-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:35:01 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-2e4fcf8a-b693-44b5-bab5-947a712e2cdb tempest-VolumesSnapshotListTestJSON-314053805 None] Acquiring lock "cinder-quobyte-3cb12caa-49b8-46f7-8884-3d894a77a4cf" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:35:01 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-2e4fcf8a-b693-44b5-bab5-947a712e2cdb tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "cinder-quobyte-3cb12caa-49b8-46f7-8884-3d894a77a4cf" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:35:01 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-2e4fcf8a-b693-44b5-bab5-947a712e2cdb tempest-VolumesSnapshotListTestJSON-314053805 None] Deleting offline snapshot 3cb12caa-49b8-46f7-8884-3d894a77a4cf of volume 6f6ed393-cfbe-4e8c-88c6-84f8bde39d35 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:35:01 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-2e4fcf8a-b693-44b5-bab5-947a712e2cdb tempest-VolumesSnapshotListTestJSON-314053805 None] snapshot_file for this snap is: volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.3cb12caa-49b8-46f7-8884-3d894a77a4cf {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:35:01 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[311c3756-9f20-445a-82c2-7fe7e4bd9053]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:35:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2e4fcf8a-b693-44b5-bab5-947a712e2cdb tempest-VolumesSnapshotListTestJSON-314053805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.3cb12caa-49b8-46f7-8884-3d894a77a4cf {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:01 devstack sudo[95351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.3cb12caa-49b8-46f7-8884-3d894a77a4cf Nov 02 15:35:01 devstack sudo[95351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:01 devstack sudo[95351]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2e4fcf8a-b693-44b5-bab5-947a712e2cdb tempest-VolumesSnapshotListTestJSON-314053805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.3cb12caa-49b8-46f7-8884-3d894a77a4cf" returned: 0 in 0.486s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:01 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-2e4fcf8a-b693-44b5-bab5-947a712e2cdb tempest-VolumesSnapshotListTestJSON-314053805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:35:01 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a63aafc9-a798-44f7-8b5b-504d6354230f tempest-VolumeQuotasAdminTestJSON-332344472 None] Acquiring lock "cinder-8cffa5db-01ad-4fe1-bd6d-63115560674c-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:35:01 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb848b1-6bcb-403d-a3dc-449f19512805]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:35:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2e4fcf8a-b693-44b5-bab5-947a712e2cdb tempest-VolumesSnapshotListTestJSON-314053805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.4046c897-eee5-48e0-a1fe-6caacf43afa1 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:01 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a63aafc9-a798-44f7-8b5b-504d6354230f tempest-VolumeQuotasAdminTestJSON-332344472 None] Lock "cinder-8cffa5db-01ad-4fe1-bd6d-63115560674c-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:35:02 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a63aafc9-a798-44f7-8b5b-504d6354230f tempest-VolumeQuotasAdminTestJSON-332344472 None] Acquiring lock "cinder-quobyte-8cffa5db-01ad-4fe1-bd6d-63115560674c" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:35:02 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a63aafc9-a798-44f7-8b5b-504d6354230f tempest-VolumeQuotasAdminTestJSON-332344472 None] Lock "cinder-quobyte-8cffa5db-01ad-4fe1-bd6d-63115560674c" acquired by "delete_volume" :: waited 0.028s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:35:02 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa41509-2856-49e2-b678-731ed2cc0dc3]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:35:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a63aafc9-a798-44f7-8b5b-504d6354230f tempest-VolumeQuotasAdminTestJSON-332344472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8cffa5db-01ad-4fe1-bd6d-63115560674c {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:02 devstack sudo[95356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.4046c897-eee5-48e0-a1fe-6caacf43afa1 Nov 02 15:35:02 devstack sudo[95356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:02 devstack sudo[95357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8cffa5db-01ad-4fe1-bd6d-63115560674c Nov 02 15:35:02 devstack sudo[95357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:02 devstack sudo[95356]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2e4fcf8a-b693-44b5-bab5-947a712e2cdb tempest-VolumesSnapshotListTestJSON-314053805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.4046c897-eee5-48e0-a1fe-6caacf43afa1" returned: 0 in 0.584s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-2e4fcf8a-b693-44b5-bab5-947a712e2cdb tempest-VolumesSnapshotListTestJSON-314053805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:35:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2e4fcf8a-b693-44b5-bab5-947a712e2cdb tempest-VolumesSnapshotListTestJSON-314053805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.3cb12caa-49b8-46f7-8884-3d894a77a4cf {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:02 devstack sudo[95364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.3cb12caa-49b8-46f7-8884-3d894a77a4cf Nov 02 15:35:02 devstack sudo[95364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:02 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:35:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] Flow 'volume_create_manager' (021f2809-079e-4d6b-b5d7-e2687d9fc5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:35:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a506b593-292e-4d26-804b-aec999f3acf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:35:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a506b593-292e-4d26-804b-aec999f3acf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-602650072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4817ac1b-3f5e-4efa-a148-e9c39c75fda3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ce89db8649f44ddacd09ab9f16fbff5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:35:02Z,use_quota=True,user_id='9d7b0bd322c247eab7a4a986da508d91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:35:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e767fd-282a-446e-ae51-88fb7d8017f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:35:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44e767fd-282a-446e-ae51-88fb7d8017f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:35:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6285cfef-3914-4db1-95f8-376c1ac3d114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:35:02 devstack sudo[95357]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6285cfef-3914-4db1-95f8-376c1ac3d114) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4817ac1b-3f5e-4efa-a148-e9c39c75fda3', 'volume_name': 'volume-4817ac1b-3f5e-4efa-a148-e9c39c75fda3', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:35:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e43dbb0b-ff00-459e-8aab-96a3f2e0dde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:35:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e43dbb0b-ff00-459e-8aab-96a3f2e0dde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:35:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99d80a2f-7bd9-4526-9d8d-b404a90e8cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:35:02 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] Volume 4817ac1b-3f5e-4efa-a148-e9c39c75fda3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4817ac1b-3f5e-4efa-a148-e9c39c75fda3', 'volume_size': 1} Nov 02 15:35:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:35:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:35:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:35:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-602650072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4817ac1b-3f5e-4efa-a148-e9c39c75fda3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ce89db8649f44ddacd09ab9f16fbff5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:35:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:35:02Z,use_quota=True,user_id='9d7b0bd322c247eab7a4a986da508d91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:35:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] Creating volume 4817ac1b-3f5e-4efa-a148-e9c39c75fda3 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:35:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:35:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:35:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:35:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:35:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:35:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:35:02 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:35:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4817ac1b-3f5e-4efa-a148-e9c39c75fda3 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a63aafc9-a798-44f7-8b5b-504d6354230f tempest-VolumeQuotasAdminTestJSON-332344472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8cffa5db-01ad-4fe1-bd6d-63115560674c" returned: 0 in 0.574s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a63aafc9-a798-44f7-8b5b-504d6354230f tempest-VolumeQuotasAdminTestJSON-332344472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8cffa5db-01ad-4fe1-bd6d-63115560674c {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:02 devstack sudo[95372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8cffa5db-01ad-4fe1-bd6d-63115560674c Nov 02 15:35:02 devstack sudo[95372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:02 devstack sudo[95371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4817ac1b-3f5e-4efa-a148-e9c39c75fda3 1073741824 Nov 02 15:35:02 devstack sudo[95371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:02 devstack sudo[95372]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a63aafc9-a798-44f7-8b5b-504d6354230f tempest-VolumeQuotasAdminTestJSON-332344472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8cffa5db-01ad-4fe1-bd6d-63115560674c" returned: 0 in 0.314s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a63aafc9-a798-44f7-8b5b-504d6354230f tempest-VolumeQuotasAdminTestJSON-332344472 None] Lock "cinder-quobyte-8cffa5db-01ad-4fe1-bd6d-63115560674c" released by "delete_volume" :: held 0.964s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:35:03 devstack sudo[95364]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2e4fcf8a-b693-44b5-bab5-947a712e2cdb tempest-VolumesSnapshotListTestJSON-314053805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.3cb12caa-49b8-46f7-8884-3d894a77a4cf" returned: 0 in 0.597s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2e4fcf8a-b693-44b5-bab5-947a712e2cdb tempest-VolumesSnapshotListTestJSON-314053805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.3cb12caa-49b8-46f7-8884-3d894a77a4cf {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:03 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-a63aafc9-a798-44f7-8b5b-504d6354230f tempest-VolumeQuotasAdminTestJSON-332344472 None] Created reservations ['b075bfbe-3514-41e0-8d6e-758f1cf15ef3', '4f19014c-4830-4d2f-a13d-07be0254a79c', 'a738e906-ab35-4f0b-bcee-927215796e14', 'e50d3378-240f-4619-8e38-bb073293e70a'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:35:03 devstack sudo[95388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.3cb12caa-49b8-46f7-8884-3d894a77a4cf Nov 02 15:35:03 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a63aafc9-a798-44f7-8b5b-504d6354230f tempest-VolumeQuotasAdminTestJSON-332344472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:35:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a63aafc9-a798-44f7-8b5b-504d6354230f tempest-VolumeQuotasAdminTestJSON-332344472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:35:03 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-a63aafc9-a798-44f7-8b5b-504d6354230f tempest-VolumeQuotasAdminTestJSON-332344472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:35:03 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-a63aafc9-a798-44f7-8b5b-504d6354230f tempest-VolumeQuotasAdminTestJSON-332344472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:35:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a63aafc9-a798-44f7-8b5b-504d6354230f tempest-VolumeQuotasAdminTestJSON-332344472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:35:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a63aafc9-a798-44f7-8b5b-504d6354230f tempest-VolumeQuotasAdminTestJSON-332344472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:03 devstack sudo[95390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:35:03 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:03 devstack sudo[95371]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4817ac1b-3f5e-4efa-a148-e9c39c75fda3 1073741824" returned: 0 in 0.652s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4817ac1b-3f5e-4efa-a148-e9c39c75fda3 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:03 devstack sudo[95392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4817ac1b-3f5e-4efa-a148-e9c39c75fda3 Nov 02 15:35:03 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:03 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2e4fcf8a-b693-44b5-bab5-947a712e2cdb tempest-VolumesSnapshotListTestJSON-314053805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.3cb12caa-49b8-46f7-8884-3d894a77a4cf" returned: 0 in 0.378s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-2e4fcf8a-b693-44b5-bab5-947a712e2cdb tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "cinder-quobyte-3cb12caa-49b8-46f7-8884-3d894a77a4cf" released by "_delete_snapshot" :: held 2.197s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:35:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-2e4fcf8a-b693-44b5-bab5-947a712e2cdb tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "cinder-quobyte-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35" released by "delete_snapshot" :: held 2.224s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:35:03 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-2e4fcf8a-b693-44b5-bab5-947a712e2cdb tempest-VolumesSnapshotListTestJSON-314053805 None] Created reservations ['7ef89a32-7314-47d3-9bf0-be05d6057a47', '869341b6-8829-4a24-ad78-fb39971bfc91', 'b91fbabb-7513-43c2-93e8-edfe500dbf7a', '26ce730d-ef0f-45e4-ae54-10f1a2ff7ace'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:35:03 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a63aafc9-a798-44f7-8b5b-504d6354230f tempest-VolumeQuotasAdminTestJSON-332344472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.383s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:03 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-a63aafc9-a798-44f7-8b5b-504d6354230f tempest-VolumeQuotasAdminTestJSON-332344472 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:35:03 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-a63aafc9-a798-44f7-8b5b-504d6354230f tempest-VolumeQuotasAdminTestJSON-332344472 None] Deleted volume successfully. Nov 02 15:35:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a63aafc9-a798-44f7-8b5b-504d6354230f tempest-VolumeQuotasAdminTestJSON-332344472 None] Lock "cinder-8cffa5db-01ad-4fe1-bd6d-63115560674c-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:35:03 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:03 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-2e4fcf8a-b693-44b5-bab5-947a712e2cdb tempest-VolumesSnapshotListTestJSON-314053805 None] Delete snapshot completed successfully. Nov 02 15:35:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4817ac1b-3f5e-4efa-a148-e9c39c75fda3" returned: 0 in 0.351s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:03 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:35:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:35:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-2e4fcf8a-b693-44b5-bab5-947a712e2cdb tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "cinder-3cb12caa-49b8-46f7-8884-3d894a77a4cf-delete_snapshot" released by "delete_snapshot" :: held 2.436s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:35:03 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99d80a2f-7bd9-4526-9d8d-b404a90e8cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4817ac1b-3f5e-4efa-a148-e9c39c75fda3', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:35:03 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (157999e8-32fb-4855-97d3-2b3bbebacea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:35:03 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] Volume volume-4817ac1b-3f5e-4efa-a148-e9c39c75fda3 (4817ac1b-3f5e-4efa-a148-e9c39c75fda3): created successfully Nov 02 15:35:03 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (157999e8-32fb-4855-97d3-2b3bbebacea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:35:03 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] Flow 'volume_create_manager' (021f2809-079e-4d6b-b5d7-e2687d9fc5f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:35:03 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-df39c20e-6c17-4dba-89f0-a7bd4d2df105 tempest-ServersNegativeTestJSON-492225478 None] Created volume successfully. Nov 02 15:35:04 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b5dd82b9-2a53-4f75-ad06-85d952d9303c tempest-VolumesSnapshotListTestJSON-314053805 None] Acquiring lock "cinder-4046c897-eee5-48e0-a1fe-6caacf43afa1-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:35:04 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b5dd82b9-2a53-4f75-ad06-85d952d9303c tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "cinder-4046c897-eee5-48e0-a1fe-6caacf43afa1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:35:04 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b5dd82b9-2a53-4f75-ad06-85d952d9303c tempest-VolumesSnapshotListTestJSON-314053805 None] Acquiring lock "cinder-quobyte-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:35:04 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b5dd82b9-2a53-4f75-ad06-85d952d9303c tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "cinder-quobyte-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:35:04 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b5dd82b9-2a53-4f75-ad06-85d952d9303c tempest-VolumesSnapshotListTestJSON-314053805 None] Acquiring lock "cinder-quobyte-4046c897-eee5-48e0-a1fe-6caacf43afa1" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:35:04 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b5dd82b9-2a53-4f75-ad06-85d952d9303c tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "cinder-quobyte-4046c897-eee5-48e0-a1fe-6caacf43afa1" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:35:04 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-b5dd82b9-2a53-4f75-ad06-85d952d9303c tempest-VolumesSnapshotListTestJSON-314053805 None] Deleting offline snapshot 4046c897-eee5-48e0-a1fe-6caacf43afa1 of volume 6f6ed393-cfbe-4e8c-88c6-84f8bde39d35 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:35:04 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-b5dd82b9-2a53-4f75-ad06-85d952d9303c tempest-VolumesSnapshotListTestJSON-314053805 None] snapshot_file for this snap is: volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.4046c897-eee5-48e0-a1fe-6caacf43afa1 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:35:04 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8608e5c0-e807-4fd0-a968-c7888234beb4]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:35:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5dd82b9-2a53-4f75-ad06-85d952d9303c tempest-VolumesSnapshotListTestJSON-314053805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.4046c897-eee5-48e0-a1fe-6caacf43afa1 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:04 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:35:04 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] Flow 'volume_create_manager' (2df52e43-5ff0-4da5-816e-7a4269d4c924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:35:04 devstack sudo[95397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.4046c897-eee5-48e0-a1fe-6caacf43afa1 Nov 02 15:35:04 devstack sudo[95397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:04 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9025678-9ae8-4770-9801-277148b1834c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:35:04 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9025678-9ae8-4770-9801-277148b1834c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1415009331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfe82f8f-e976-462e-b743-500db967d316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b042000328647519bf13fe5c9879ccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:35:05Z,use_quota=True,user_id='3f750d5fd8634d30a2f0caa26d00890c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:35:04 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df95983c-387f-478b-bc86-7e5b185f6bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:35:04 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df95983c-387f-478b-bc86-7e5b185f6bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:35:04 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef957f9-3f5d-4292-a7bf-d166d21b195e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:35:04 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ef957f9-3f5d-4292-a7bf-d166d21b195e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfe82f8f-e976-462e-b743-500db967d316', 'volume_name': 'volume-bfe82f8f-e976-462e-b743-500db967d316', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:35:04 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (799da245-5eda-47f0-9676-6d21e8c858d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:35:04 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (799da245-5eda-47f0-9676-6d21e8c858d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:35:04 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c7427c-7e5e-4ecf-99df-6604f93747aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:35:04 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] Volume bfe82f8f-e976-462e-b743-500db967d316: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfe82f8f-e976-462e-b743-500db967d316', 'volume_size': 1} Nov 02 15:35:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:35:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:35:04 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1415009331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfe82f8f-e976-462e-b743-500db967d316,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b042000328647519bf13fe5c9879ccb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:35:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:35:05Z,use_quota=True,user_id='3f750d5fd8634d30a2f0caa26d00890c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:35:04 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] Creating volume bfe82f8f-e976-462e-b743-500db967d316 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:35:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:35:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:35:04 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:35:04 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:35:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:35:04 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:35:04 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:35:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bfe82f8f-e976-462e-b743-500db967d316 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:05 devstack sudo[95402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bfe82f8f-e976-462e-b743-500db967d316 1073741824 Nov 02 15:35:05 devstack sudo[95402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:05 devstack sudo[95397]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5dd82b9-2a53-4f75-ad06-85d952d9303c tempest-VolumesSnapshotListTestJSON-314053805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.4046c897-eee5-48e0-a1fe-6caacf43afa1" returned: 0 in 0.508s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:05 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-b5dd82b9-2a53-4f75-ad06-85d952d9303c tempest-VolumesSnapshotListTestJSON-314053805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:35:05 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-65e1fe55-5957-44d7-9a2b-602ee37e17fa tempest-ServersNegativeTestJSON-492225478 None] Acquiring lock "cinder-4817ac1b-3f5e-4efa-a148-e9c39c75fda3-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:35:05 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-65e1fe55-5957-44d7-9a2b-602ee37e17fa tempest-ServersNegativeTestJSON-492225478 None] Lock "cinder-4817ac1b-3f5e-4efa-a148-e9c39c75fda3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:35:05 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a2737d-ba68-41d6-8ae7-0bb1f1d7986a]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:35:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5dd82b9-2a53-4f75-ad06-85d952d9303c tempest-VolumesSnapshotListTestJSON-314053805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.c2092838-084f-4129-94a9-27d502989012 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:05 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-65e1fe55-5957-44d7-9a2b-602ee37e17fa tempest-ServersNegativeTestJSON-492225478 None] Acquiring lock "cinder-quobyte-4817ac1b-3f5e-4efa-a148-e9c39c75fda3" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:35:05 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-65e1fe55-5957-44d7-9a2b-602ee37e17fa tempest-ServersNegativeTestJSON-492225478 None] Lock "cinder-quobyte-4817ac1b-3f5e-4efa-a148-e9c39c75fda3" acquired by "delete_volume" :: waited 0.028s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:35:05 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dd623f-4d70-4e8e-bd67-d106647adee8]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:35:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-65e1fe55-5957-44d7-9a2b-602ee37e17fa tempest-ServersNegativeTestJSON-492225478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4817ac1b-3f5e-4efa-a148-e9c39c75fda3 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:05 devstack sudo[95423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.c2092838-084f-4129-94a9-27d502989012 Nov 02 15:35:05 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:05 devstack sudo[95427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4817ac1b-3f5e-4efa-a148-e9c39c75fda3 Nov 02 15:35:05 devstack sudo[95427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:05 devstack sudo[95402]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bfe82f8f-e976-462e-b743-500db967d316 1073741824" returned: 0 in 0.604s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bfe82f8f-e976-462e-b743-500db967d316 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:05 devstack sudo[95430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bfe82f8f-e976-462e-b743-500db967d316 Nov 02 15:35:05 devstack sudo[95430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:05 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5dd82b9-2a53-4f75-ad06-85d952d9303c tempest-VolumesSnapshotListTestJSON-314053805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.c2092838-084f-4129-94a9-27d502989012" returned: 0 in 0.478s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:05 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-b5dd82b9-2a53-4f75-ad06-85d952d9303c tempest-VolumesSnapshotListTestJSON-314053805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:35:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5dd82b9-2a53-4f75-ad06-85d952d9303c tempest-VolumesSnapshotListTestJSON-314053805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.4046c897-eee5-48e0-a1fe-6caacf43afa1 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:05 devstack sudo[95437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.4046c897-eee5-48e0-a1fe-6caacf43afa1 Nov 02 15:35:05 devstack sudo[95437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:05 devstack sudo[95427]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-65e1fe55-5957-44d7-9a2b-602ee37e17fa tempest-ServersNegativeTestJSON-492225478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4817ac1b-3f5e-4efa-a148-e9c39c75fda3" returned: 0 in 0.447s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-65e1fe55-5957-44d7-9a2b-602ee37e17fa tempest-ServersNegativeTestJSON-492225478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4817ac1b-3f5e-4efa-a148-e9c39c75fda3 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:05 devstack sudo[95430]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bfe82f8f-e976-462e-b743-500db967d316" returned: 0 in 0.269s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:05 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:35:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:35:05 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3c7427c-7e5e-4ecf-99df-6604f93747aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfe82f8f-e976-462e-b743-500db967d316', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:35:05 devstack sudo[95442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4817ac1b-3f5e-4efa-a148-e9c39c75fda3 Nov 02 15:35:05 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:05 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d8fb933-98e5-4e03-b770-7c91d7b53bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:35:05 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] Volume volume-bfe82f8f-e976-462e-b743-500db967d316 (bfe82f8f-e976-462e-b743-500db967d316): created successfully Nov 02 15:35:05 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d8fb933-98e5-4e03-b770-7c91d7b53bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:35:05 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] Flow 'volume_create_manager' (2df52e43-5ff0-4da5-816e-7a4269d4c924) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:35:05 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-f09cc017-c5d6-4aa5-b367-c73ce5bc1def tempest-VolumeQuotasAdminTestJSON-332344472 None] Created volume successfully. Nov 02 15:35:06 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-65e1fe55-5957-44d7-9a2b-602ee37e17fa tempest-ServersNegativeTestJSON-492225478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4817ac1b-3f5e-4efa-a148-e9c39c75fda3" returned: 0 in 0.260s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-65e1fe55-5957-44d7-9a2b-602ee37e17fa tempest-ServersNegativeTestJSON-492225478 None] Lock "cinder-quobyte-4817ac1b-3f5e-4efa-a148-e9c39c75fda3" released by "delete_volume" :: held 0.763s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:35:06 devstack sudo[95437]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5dd82b9-2a53-4f75-ad06-85d952d9303c tempest-VolumesSnapshotListTestJSON-314053805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.4046c897-eee5-48e0-a1fe-6caacf43afa1" returned: 0 in 0.394s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5dd82b9-2a53-4f75-ad06-85d952d9303c tempest-VolumesSnapshotListTestJSON-314053805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.4046c897-eee5-48e0-a1fe-6caacf43afa1 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:06 devstack sudo[95448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.4046c897-eee5-48e0-a1fe-6caacf43afa1 Nov 02 15:35:06 devstack sudo[95448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-65e1fe55-5957-44d7-9a2b-602ee37e17fa tempest-ServersNegativeTestJSON-492225478 None] Created reservations ['edcb8a07-9fa9-4a5c-be16-e12d1b004a51', '85a7b9c6-158b-43a9-b9a4-534de101de27', '4d07cecf-8696-450d-b0dd-df56a5356378', '1ea699c0-a46b-4d48-85f5-7facee742cf2'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-65e1fe55-5957-44d7-9a2b-602ee37e17fa tempest-ServersNegativeTestJSON-492225478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-65e1fe55-5957-44d7-9a2b-602ee37e17fa tempest-ServersNegativeTestJSON-492225478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-65e1fe55-5957-44d7-9a2b-602ee37e17fa tempest-ServersNegativeTestJSON-492225478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-65e1fe55-5957-44d7-9a2b-602ee37e17fa tempest-ServersNegativeTestJSON-492225478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-65e1fe55-5957-44d7-9a2b-602ee37e17fa tempest-ServersNegativeTestJSON-492225478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-65e1fe55-5957-44d7-9a2b-602ee37e17fa tempest-ServersNegativeTestJSON-492225478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:06 devstack sudo[95450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:35:06 devstack sudo[95450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:06 devstack sudo[95448]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b5dd82b9-2a53-4f75-ad06-85d952d9303c tempest-VolumesSnapshotListTestJSON-314053805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.4046c897-eee5-48e0-a1fe-6caacf43afa1" returned: 0 in 0.263s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-24d3d125-c67a-4977-b900-28ec637d5d83 tempest-ServersNegativeTestJSON-492225478 None] Acquiring lock "cinder-5277a25f-f853-462d-9a8a-fbebe0960444-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b5dd82b9-2a53-4f75-ad06-85d952d9303c tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "cinder-quobyte-4046c897-eee5-48e0-a1fe-6caacf43afa1" released by "_delete_snapshot" :: held 1.866s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b5dd82b9-2a53-4f75-ad06-85d952d9303c tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "cinder-quobyte-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35" released by "delete_snapshot" :: held 1.930s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-24d3d125-c67a-4977-b900-28ec637d5d83 tempest-ServersNegativeTestJSON-492225478 None] Lock "cinder-5277a25f-f853-462d-9a8a-fbebe0960444-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:35:06 devstack sudo[95450]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-24d3d125-c67a-4977-b900-28ec637d5d83 tempest-ServersNegativeTestJSON-492225478 None] Acquiring lock "cinder-quobyte-5277a25f-f853-462d-9a8a-fbebe0960444" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-65e1fe55-5957-44d7-9a2b-602ee37e17fa tempest-ServersNegativeTestJSON-492225478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.271s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-65e1fe55-5957-44d7-9a2b-602ee37e17fa tempest-ServersNegativeTestJSON-492225478 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:35:06 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-65e1fe55-5957-44d7-9a2b-602ee37e17fa tempest-ServersNegativeTestJSON-492225478 None] Deleted volume successfully. Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-24d3d125-c67a-4977-b900-28ec637d5d83 tempest-ServersNegativeTestJSON-492225478 None] Lock "cinder-quobyte-5277a25f-f853-462d-9a8a-fbebe0960444" acquired by "delete_volume" :: waited 0.023s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60007a2-2389-4963-8498-6f84e23274fd]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-24d3d125-c67a-4977-b900-28ec637d5d83 tempest-ServersNegativeTestJSON-492225478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5277a25f-f853-462d-9a8a-fbebe0960444 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-65e1fe55-5957-44d7-9a2b-602ee37e17fa tempest-ServersNegativeTestJSON-492225478 None] Lock "cinder-4817ac1b-3f5e-4efa-a148-e9c39c75fda3-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-b5dd82b9-2a53-4f75-ad06-85d952d9303c tempest-VolumesSnapshotListTestJSON-314053805 None] Created reservations ['22c53ab8-230b-4cdf-b784-ea81fe3d9956', '0d050f66-c62c-4785-8c03-7734862b7316', '8629f5cd-c033-45e0-aa98-c291b7b76850', '6124b105-c743-4da6-8c34-9002420492fc'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:35:06 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-b5dd82b9-2a53-4f75-ad06-85d952d9303c tempest-VolumesSnapshotListTestJSON-314053805 None] Delete snapshot completed successfully. Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b5dd82b9-2a53-4f75-ad06-85d952d9303c tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "cinder-4046c897-eee5-48e0-a1fe-6caacf43afa1-delete_snapshot" released by "delete_snapshot" :: held 2.160s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:35:06 devstack sudo[95454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5277a25f-f853-462d-9a8a-fbebe0960444 Nov 02 15:35:06 devstack sudo[95454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8f8768e3-d8c7-40a7-b6ff-169fdb3a01cd tempest-VolumesSnapshotListTestJSON-314053805 None] Acquiring lock "cinder-c2092838-084f-4129-94a9-27d502989012-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8f8768e3-d8c7-40a7-b6ff-169fdb3a01cd tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "cinder-c2092838-084f-4129-94a9-27d502989012-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8f8768e3-d8c7-40a7-b6ff-169fdb3a01cd tempest-VolumesSnapshotListTestJSON-314053805 None] Acquiring lock "cinder-quobyte-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8f8768e3-d8c7-40a7-b6ff-169fdb3a01cd tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "cinder-quobyte-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8f8768e3-d8c7-40a7-b6ff-169fdb3a01cd tempest-VolumesSnapshotListTestJSON-314053805 None] Acquiring lock "cinder-quobyte-c2092838-084f-4129-94a9-27d502989012" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8f8768e3-d8c7-40a7-b6ff-169fdb3a01cd tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "cinder-quobyte-c2092838-084f-4129-94a9-27d502989012" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-8f8768e3-d8c7-40a7-b6ff-169fdb3a01cd tempest-VolumesSnapshotListTestJSON-314053805 None] Deleting offline snapshot c2092838-084f-4129-94a9-27d502989012 of volume 6f6ed393-cfbe-4e8c-88c6-84f8bde39d35 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-8f8768e3-d8c7-40a7-b6ff-169fdb3a01cd tempest-VolumesSnapshotListTestJSON-314053805 None] snapshot_file for this snap is: volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.c2092838-084f-4129-94a9-27d502989012 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e207fc-1209-4814-9964-6b3ff17fefe1]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:35:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8f8768e3-d8c7-40a7-b6ff-169fdb3a01cd tempest-VolumesSnapshotListTestJSON-314053805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.c2092838-084f-4129-94a9-27d502989012 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:07 devstack sudo[95454]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-24d3d125-c67a-4977-b900-28ec637d5d83 tempest-ServersNegativeTestJSON-492225478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5277a25f-f853-462d-9a8a-fbebe0960444" returned: 0 in 0.405s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-24d3d125-c67a-4977-b900-28ec637d5d83 tempest-ServersNegativeTestJSON-492225478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5277a25f-f853-462d-9a8a-fbebe0960444 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:07 devstack sudo[95457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.c2092838-084f-4129-94a9-27d502989012 Nov 02 15:35:07 devstack sudo[95457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:07 devstack sudo[95460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5277a25f-f853-462d-9a8a-fbebe0960444 Nov 02 15:35:07 devstack sudo[95460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:07 devstack sudo[95460]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-24d3d125-c67a-4977-b900-28ec637d5d83 tempest-ServersNegativeTestJSON-492225478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5277a25f-f853-462d-9a8a-fbebe0960444" returned: 0 in 0.270s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:07 devstack sudo[95457]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:07 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-24d3d125-c67a-4977-b900-28ec637d5d83 tempest-ServersNegativeTestJSON-492225478 None] Lock "cinder-quobyte-5277a25f-f853-462d-9a8a-fbebe0960444" released by "delete_volume" :: held 0.736s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:35:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8f8768e3-d8c7-40a7-b6ff-169fdb3a01cd tempest-VolumesSnapshotListTestJSON-314053805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.c2092838-084f-4129-94a9-27d502989012" returned: 0 in 0.399s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:07 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-8f8768e3-d8c7-40a7-b6ff-169fdb3a01cd tempest-VolumesSnapshotListTestJSON-314053805 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:35:07 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d5f89d-8e4a-4edf-a3da-4c3ed73b6d63]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:35:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8f8768e3-d8c7-40a7-b6ff-169fdb3a01cd tempest-VolumesSnapshotListTestJSON-314053805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:07 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-24d3d125-c67a-4977-b900-28ec637d5d83 tempest-ServersNegativeTestJSON-492225478 None] Created reservations ['e8c3c621-cb7e-48ee-b77a-6f22444d63f1', '4e6c90f5-4747-49c1-a18f-382421d96559', '5fb83c20-c88a-4848-928e-7ce303858c30', '260c6749-97ca-47ab-b186-f036977603c9'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:35:07 devstack sudo[95467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35 Nov 02 15:35:07 devstack sudo[95467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-24d3d125-c67a-4977-b900-28ec637d5d83 tempest-ServersNegativeTestJSON-492225478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:35:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-24d3d125-c67a-4977-b900-28ec637d5d83 tempest-ServersNegativeTestJSON-492225478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:35:07 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-24d3d125-c67a-4977-b900-28ec637d5d83 tempest-ServersNegativeTestJSON-492225478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:35:07 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-24d3d125-c67a-4977-b900-28ec637d5d83 tempest-ServersNegativeTestJSON-492225478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:35:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-24d3d125-c67a-4977-b900-28ec637d5d83 tempest-ServersNegativeTestJSON-492225478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:35:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-24d3d125-c67a-4977-b900-28ec637d5d83 tempest-ServersNegativeTestJSON-492225478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:07 devstack sudo[95469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:35:07 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:07 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-bdd5890a-28d4-49b6-adab-9744f0f10e0f tempest-VolumeQuotasAdminTestJSON-1044721711 None] Transfer volume completed successfully. Nov 02 15:35:07 devstack sudo[95467]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8f8768e3-d8c7-40a7-b6ff-169fdb3a01cd tempest-VolumesSnapshotListTestJSON-314053805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35" returned: 0 in 0.414s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8f8768e3-d8c7-40a7-b6ff-169fdb3a01cd tempest-VolumesSnapshotListTestJSON-314053805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.c2092838-084f-4129-94a9-27d502989012 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:07 devstack sudo[95474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.c2092838-084f-4129-94a9-27d502989012 Nov 02 15:35:07 devstack sudo[95474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:07 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-24d3d125-c67a-4977-b900-28ec637d5d83 tempest-ServersNegativeTestJSON-492225478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.377s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:07 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-24d3d125-c67a-4977-b900-28ec637d5d83 tempest-ServersNegativeTestJSON-492225478 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:35:07 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-24d3d125-c67a-4977-b900-28ec637d5d83 tempest-ServersNegativeTestJSON-492225478 None] Deleted volume successfully. Nov 02 15:35:07 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-24d3d125-c67a-4977-b900-28ec637d5d83 tempest-ServersNegativeTestJSON-492225478 None] Lock "cinder-5277a25f-f853-462d-9a8a-fbebe0960444-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:35:08 devstack sudo[95474]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8f8768e3-d8c7-40a7-b6ff-169fdb3a01cd tempest-VolumesSnapshotListTestJSON-314053805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.c2092838-084f-4129-94a9-27d502989012" returned: 0 in 0.493s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8f8768e3-d8c7-40a7-b6ff-169fdb3a01cd tempest-VolumesSnapshotListTestJSON-314053805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.c2092838-084f-4129-94a9-27d502989012 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:08 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c76559b7-63da-4030-bfda-06a85203a3f7 tempest-VolumeQuotasAdminTestJSON-680194819 None] Acquiring lock "cinder-bfe82f8f-e976-462e-b743-500db967d316-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:35:08 devstack sudo[95484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.c2092838-084f-4129-94a9-27d502989012 Nov 02 15:35:08 devstack sudo[95484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:08 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c76559b7-63da-4030-bfda-06a85203a3f7 tempest-VolumeQuotasAdminTestJSON-680194819 None] Lock "cinder-bfe82f8f-e976-462e-b743-500db967d316-delete_volume" acquired by "delete_volume" :: waited 0.158s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:35:08 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c76559b7-63da-4030-bfda-06a85203a3f7 tempest-VolumeQuotasAdminTestJSON-680194819 None] Acquiring lock "cinder-quobyte-bfe82f8f-e976-462e-b743-500db967d316" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:35:08 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c76559b7-63da-4030-bfda-06a85203a3f7 tempest-VolumeQuotasAdminTestJSON-680194819 None] Lock "cinder-quobyte-bfe82f8f-e976-462e-b743-500db967d316" acquired by "delete_volume" :: waited 0.022s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:35:08 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb994fcf-7e47-45d7-bfab-fc33a9e7890a]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:35:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c76559b7-63da-4030-bfda-06a85203a3f7 tempest-VolumeQuotasAdminTestJSON-680194819 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bfe82f8f-e976-462e-b743-500db967d316 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:08 devstack sudo[95484]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8f8768e3-d8c7-40a7-b6ff-169fdb3a01cd tempest-VolumesSnapshotListTestJSON-314053805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35.c2092838-084f-4129-94a9-27d502989012" returned: 0 in 0.451s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:08 devstack sudo[95499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bfe82f8f-e976-462e-b743-500db967d316 Nov 02 15:35:08 devstack sudo[95499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:08 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8f8768e3-d8c7-40a7-b6ff-169fdb3a01cd tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "cinder-quobyte-c2092838-084f-4129-94a9-27d502989012" released by "_delete_snapshot" :: held 1.920s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:35:08 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8f8768e3-d8c7-40a7-b6ff-169fdb3a01cd tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "cinder-quobyte-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35" released by "delete_snapshot" :: held 1.953s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:35:08 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-8f8768e3-d8c7-40a7-b6ff-169fdb3a01cd tempest-VolumesSnapshotListTestJSON-314053805 None] Created reservations ['4ec96632-f04f-4428-aa46-1c33772b783b', '3147f22c-ef53-45e9-a5b2-aa9bcfdb0eec', 'd12df20f-b966-47cc-8021-c058fcdff0fa', '0042aa76-0219-4a2d-a9d9-c1092d218228'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:35:08 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-8f8768e3-d8c7-40a7-b6ff-169fdb3a01cd tempest-VolumesSnapshotListTestJSON-314053805 None] Delete snapshot completed successfully. Nov 02 15:35:08 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8f8768e3-d8c7-40a7-b6ff-169fdb3a01cd tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "cinder-c2092838-084f-4129-94a9-27d502989012-delete_snapshot" released by "delete_snapshot" :: held 2.156s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:35:09 devstack sudo[95499]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c76559b7-63da-4030-bfda-06a85203a3f7 tempest-VolumeQuotasAdminTestJSON-680194819 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bfe82f8f-e976-462e-b743-500db967d316" returned: 0 in 0.451s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c76559b7-63da-4030-bfda-06a85203a3f7 tempest-VolumeQuotasAdminTestJSON-680194819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bfe82f8f-e976-462e-b743-500db967d316 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:09 devstack sudo[95508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bfe82f8f-e976-462e-b743-500db967d316 Nov 02 15:35:09 devstack sudo[95508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:09 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-01b40842-ed9c-40ec-9665-241e2d66671e tempest-VolumesSnapshotListTestJSON-314053805 None] Acquiring lock "cinder-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:35:09 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-01b40842-ed9c-40ec-9665-241e2d66671e tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "cinder-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:35:09 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-01b40842-ed9c-40ec-9665-241e2d66671e tempest-VolumesSnapshotListTestJSON-314053805 None] Acquiring lock "cinder-quobyte-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:35:09 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-01b40842-ed9c-40ec-9665-241e2d66671e tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "cinder-quobyte-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35" acquired by "delete_volume" :: waited 0.018s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:35:09 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6945d9-ebd7-43c1-9a3a-48afc755e0f9]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:35:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-01b40842-ed9c-40ec-9665-241e2d66671e tempest-VolumesSnapshotListTestJSON-314053805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:09 devstack sudo[95508]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c76559b7-63da-4030-bfda-06a85203a3f7 tempest-VolumeQuotasAdminTestJSON-680194819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bfe82f8f-e976-462e-b743-500db967d316" returned: 0 in 0.334s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:09 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c76559b7-63da-4030-bfda-06a85203a3f7 tempest-VolumeQuotasAdminTestJSON-680194819 None] Lock "cinder-quobyte-bfe82f8f-e976-462e-b743-500db967d316" released by "delete_volume" :: held 0.844s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:35:09 devstack sudo[95510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35 Nov 02 15:35:09 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:09 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-c76559b7-63da-4030-bfda-06a85203a3f7 tempest-VolumeQuotasAdminTestJSON-680194819 None] Created reservations ['b5ee39bc-f52d-42df-9aae-97c786ec0a12', '38924151-8226-4fdc-99f0-2591147c2697', '2468b3a3-16af-4ccb-afe7-d52bb9012b11', '7c46e82f-8fdb-4e6f-bca1-686d555f459b'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:35:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c76559b7-63da-4030-bfda-06a85203a3f7 tempest-VolumeQuotasAdminTestJSON-680194819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:35:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c76559b7-63da-4030-bfda-06a85203a3f7 tempest-VolumeQuotasAdminTestJSON-680194819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:35:09 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c76559b7-63da-4030-bfda-06a85203a3f7 tempest-VolumeQuotasAdminTestJSON-680194819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:35:09 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c76559b7-63da-4030-bfda-06a85203a3f7 tempest-VolumeQuotasAdminTestJSON-680194819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:35:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c76559b7-63da-4030-bfda-06a85203a3f7 tempest-VolumeQuotasAdminTestJSON-680194819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:35:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c76559b7-63da-4030-bfda-06a85203a3f7 tempest-VolumeQuotasAdminTestJSON-680194819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:09 devstack sudo[95514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:35:09 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:09 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-01b40842-ed9c-40ec-9665-241e2d66671e tempest-VolumesSnapshotListTestJSON-314053805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35" returned: 0 in 0.481s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-01b40842-ed9c-40ec-9665-241e2d66671e tempest-VolumesSnapshotListTestJSON-314053805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:09 devstack sudo[95519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35 Nov 02 15:35:09 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:09 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c76559b7-63da-4030-bfda-06a85203a3f7 tempest-VolumeQuotasAdminTestJSON-680194819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.266s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:09 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-c76559b7-63da-4030-bfda-06a85203a3f7 tempest-VolumeQuotasAdminTestJSON-680194819 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:35:09 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-c76559b7-63da-4030-bfda-06a85203a3f7 tempest-VolumeQuotasAdminTestJSON-680194819 None] Deleted volume successfully. Nov 02 15:35:09 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c76559b7-63da-4030-bfda-06a85203a3f7 tempest-VolumeQuotasAdminTestJSON-680194819 None] Lock "cinder-bfe82f8f-e976-462e-b743-500db967d316-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:35:10 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-01b40842-ed9c-40ec-9665-241e2d66671e tempest-VolumesSnapshotListTestJSON-314053805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35" returned: 0 in 0.265s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:10 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-01b40842-ed9c-40ec-9665-241e2d66671e tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "cinder-quobyte-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35" released by "delete_volume" :: held 0.827s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:35:10 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-01b40842-ed9c-40ec-9665-241e2d66671e tempest-VolumesSnapshotListTestJSON-314053805 None] Created reservations ['bcec5241-ae68-4711-97b3-85a36243103e', '27903306-8e29-4893-8c90-3048c7deb12b', 'e6a7d68b-9cd0-4e2a-9c0b-8c0a9f42a261', '51698c95-bc58-47f8-8d3a-b3a00f6a6ff1'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:35:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-01b40842-ed9c-40ec-9665-241e2d66671e tempest-VolumesSnapshotListTestJSON-314053805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:35:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-01b40842-ed9c-40ec-9665-241e2d66671e tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:35:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-01b40842-ed9c-40ec-9665-241e2d66671e tempest-VolumesSnapshotListTestJSON-314053805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:35:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-01b40842-ed9c-40ec-9665-241e2d66671e tempest-VolumesSnapshotListTestJSON-314053805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:35:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-01b40842-ed9c-40ec-9665-241e2d66671e tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:35:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-01b40842-ed9c-40ec-9665-241e2d66671e tempest-VolumesSnapshotListTestJSON-314053805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:10 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:35:10 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:10 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-01b40842-ed9c-40ec-9665-241e2d66671e tempest-VolumesSnapshotListTestJSON-314053805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.307s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:10 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-01b40842-ed9c-40ec-9665-241e2d66671e tempest-VolumesSnapshotListTestJSON-314053805 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:35:10 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-01b40842-ed9c-40ec-9665-241e2d66671e tempest-VolumesSnapshotListTestJSON-314053805 None] Deleted volume successfully. Nov 02 15:35:10 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-01b40842-ed9c-40ec-9665-241e2d66671e tempest-VolumesSnapshotListTestJSON-314053805 None] Lock "cinder-6f6ed393-cfbe-4e8c-88c6-84f8bde39d35-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:35:17 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:35:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Flow 'volume_create_manager' (9dcb351e-56e3-4b21-b30a-fcac1780cb8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:35:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9e1a95c-a6b3-4dc3-a59b-5b25ebeb62f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:35:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9e1a95c-a6b3-4dc3-a59b-5b25ebeb62f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1641990844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a4cda32-d7a2-4508-b55e-348ef80e69db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34326a5c5bdf40d0aec4031d252e3277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:35:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:35:17Z,use_quota=True,user_id='c9cd0dc39b974f19a3df7f5eb46cf56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:35:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4127210-5ab3-429e-b07d-470d55718389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:35:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4127210-5ab3-429e-b07d-470d55718389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:35:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d93e34a9-88eb-4dde-a4f2-265ecd137291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:35:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d93e34a9-88eb-4dde-a4f2-265ecd137291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a4cda32-d7a2-4508-b55e-348ef80e69db', 'volume_name': 'volume-3a4cda32-d7a2-4508-b55e-348ef80e69db', 'volume_size': 2}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:35:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d223d5c-5536-4915-abf2-dbae87258d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:35:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d223d5c-5536-4915-abf2-dbae87258d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:35:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb523e5d-994c-4a17-9e20-c5e272849eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:35:17 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Volume 3a4cda32-d7a2-4508-b55e-348ef80e69db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a4cda32-d7a2-4508-b55e-348ef80e69db', 'volume_size': 2} Nov 02 15:35:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:35:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:35:17 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1641990844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a4cda32-d7a2-4508-b55e-348ef80e69db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34326a5c5bdf40d0aec4031d252e3277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:35:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:35:17Z,use_quota=True,user_id='c9cd0dc39b974f19a3df7f5eb46cf56b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:35:17 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Creating volume 3a4cda32-d7a2-4508-b55e-348ef80e69db {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:35:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:35:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:35:17 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:35:17 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:35:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:35:17 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:35:17 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:35:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db 2147483648 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:17 devstack sudo[95546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db 2147483648 Nov 02 15:35:17 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:17 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db 2147483648" returned: 0 in 0.536s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:18 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db Nov 02 15:35:18 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:18 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db" returned: 0 in 0.266s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:18 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:35:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:35:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb523e5d-994c-4a17-9e20-c5e272849eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a4cda32-d7a2-4508-b55e-348ef80e69db', 'volume_size': 2}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:35:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57e0aa7-afcd-463d-a676-ff42a4a3bfc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:35:18 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Volume volume-3a4cda32-d7a2-4508-b55e-348ef80e69db (3a4cda32-d7a2-4508-b55e-348ef80e69db): created successfully Nov 02 15:35:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c57e0aa7-afcd-463d-a676-ff42a4a3bfc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:35:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Flow 'volume_create_manager' (9dcb351e-56e3-4b21-b30a-fcac1780cb8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:35:19 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-2e575d0b-14d7-4e84-b7a8-37e66b295235 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Created volume successfully. Nov 02 15:35:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-795dd2c1-76dd-4336-94f5-e27c56410f6d tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:35:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-795dd2c1-76dd-4336-94f5-e27c56410f6d tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:35:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-795dd2c1-76dd-4336-94f5-e27c56410f6d tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Creating offline snapshot 1f1cf7bc-d6b7-47bd-9110-028bc99757f2 of volume 3a4cda32-d7a2-4508-b55e-348ef80e69db {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:35:20 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[638506d0-ce0f-424c-bc97-6ea4d6bf8dd2]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:35:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-795dd2c1-76dd-4336-94f5-e27c56410f6d tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:20 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:35:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:35:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:35:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:35:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:35:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:35:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:20 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:35:20 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:20 devstack sudo[95579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db Nov 02 15:35:20 devstack sudo[95579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:20 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.350s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:20 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:35:21 devstack sudo[95579]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-795dd2c1-76dd-4336-94f5-e27c56410f6d tempest-VolumesSnapshotNegativeTestJSON-772339606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db" returned: 0 in 0.645s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-795dd2c1-76dd-4336-94f5-e27c56410f6d tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db.1f1cf7bc-d6b7-47bd-9110-028bc99757f2 2G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:21 devstack sudo[95589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db.1f1cf7bc-d6b7-47bd-9110-028bc99757f2 2G Nov 02 15:35:21 devstack sudo[95589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:21 devstack sudo[95589]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-795dd2c1-76dd-4336-94f5-e27c56410f6d tempest-VolumesSnapshotNegativeTestJSON-772339606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db.1f1cf7bc-d6b7-47bd-9110-028bc99757f2 2G" returned: 0 in 0.757s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-795dd2c1-76dd-4336-94f5-e27c56410f6d tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a4cda32-d7a2-4508-b55e-348ef80e69db -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db.1f1cf7bc-d6b7-47bd-9110-028bc99757f2 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:21 devstack sudo[95611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a4cda32-d7a2-4508-b55e-348ef80e69db -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db.1f1cf7bc-d6b7-47bd-9110-028bc99757f2 Nov 02 15:35:21 devstack sudo[95611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:22 devstack sudo[95611]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-795dd2c1-76dd-4336-94f5-e27c56410f6d tempest-VolumesSnapshotNegativeTestJSON-772339606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a4cda32-d7a2-4508-b55e-348ef80e69db -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db.1f1cf7bc-d6b7-47bd-9110-028bc99757f2" returned: 0 in 0.403s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:22 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-795dd2c1-76dd-4336-94f5-e27c56410f6d tempest-VolumesSnapshotNegativeTestJSON-772339606 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db.1f1cf7bc-d6b7-47bd-9110-028bc99757f2 is being set with open permissions: ugo+rw Nov 02 15:35:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-795dd2c1-76dd-4336-94f5-e27c56410f6d tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db.1f1cf7bc-d6b7-47bd-9110-028bc99757f2 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:22 devstack sudo[95616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db.1f1cf7bc-d6b7-47bd-9110-028bc99757f2 Nov 02 15:35:22 devstack sudo[95616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:22 devstack sudo[95616]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-795dd2c1-76dd-4336-94f5-e27c56410f6d tempest-VolumesSnapshotNegativeTestJSON-772339606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db.1f1cf7bc-d6b7-47bd-9110-028bc99757f2" returned: 0 in 0.300s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-795dd2c1-76dd-4336-94f5-e27c56410f6d tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:22 devstack sudo[95619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db.info Nov 02 15:35:22 devstack sudo[95619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:22 devstack sudo[95619]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-795dd2c1-76dd-4336-94f5-e27c56410f6d tempest-VolumesSnapshotNegativeTestJSON-772339606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db.info" returned: 0 in 0.298s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:22 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-795dd2c1-76dd-4336-94f5-e27c56410f6d tempest-VolumesSnapshotNegativeTestJSON-772339606 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db.info is being set with open permissions: ugo+rw Nov 02 15:35:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-795dd2c1-76dd-4336-94f5-e27c56410f6d tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:23 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db.info Nov 02 15:35:23 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:23 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-795dd2c1-76dd-4336-94f5-e27c56410f6d tempest-VolumesSnapshotNegativeTestJSON-772339606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db.info" returned: 0 in 0.307s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-795dd2c1-76dd-4336-94f5-e27c56410f6d tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.866s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:35:23 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-795dd2c1-76dd-4336-94f5-e27c56410f6d tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Create snapshot completed successfully Nov 02 15:35:23 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3b8adf91-a2f5-4ca8-8ab8-c4a34c239a70 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Acquiring lock "cinder-1f1cf7bc-d6b7-47bd-9110-028bc99757f2-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:35:23 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3b8adf91-a2f5-4ca8-8ab8-c4a34c239a70 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Lock "cinder-1f1cf7bc-d6b7-47bd-9110-028bc99757f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:35:23 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3b8adf91-a2f5-4ca8-8ab8-c4a34c239a70 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Acquiring lock "cinder-quobyte-3a4cda32-d7a2-4508-b55e-348ef80e69db" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:35:23 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3b8adf91-a2f5-4ca8-8ab8-c4a34c239a70 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Lock "cinder-quobyte-3a4cda32-d7a2-4508-b55e-348ef80e69db" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:35:23 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3b8adf91-a2f5-4ca8-8ab8-c4a34c239a70 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Acquiring lock "cinder-quobyte-1f1cf7bc-d6b7-47bd-9110-028bc99757f2" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:35:23 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3b8adf91-a2f5-4ca8-8ab8-c4a34c239a70 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Lock "cinder-quobyte-1f1cf7bc-d6b7-47bd-9110-028bc99757f2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:35:23 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-3b8adf91-a2f5-4ca8-8ab8-c4a34c239a70 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Deleting offline snapshot 1f1cf7bc-d6b7-47bd-9110-028bc99757f2 of volume 3a4cda32-d7a2-4508-b55e-348ef80e69db {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:35:23 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-3b8adf91-a2f5-4ca8-8ab8-c4a34c239a70 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] snapshot_file for this snap is: volume-3a4cda32-d7a2-4508-b55e-348ef80e69db.1f1cf7bc-d6b7-47bd-9110-028bc99757f2 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:35:23 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21714ef-92c1-4ccf-a7e9-7cbefe27ba95]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:35:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3b8adf91-a2f5-4ca8-8ab8-c4a34c239a70 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db.1f1cf7bc-d6b7-47bd-9110-028bc99757f2 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:24 devstack sudo[95625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db.1f1cf7bc-d6b7-47bd-9110-028bc99757f2 Nov 02 15:35:24 devstack sudo[95625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:24 devstack sudo[95625]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3b8adf91-a2f5-4ca8-8ab8-c4a34c239a70 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db.1f1cf7bc-d6b7-47bd-9110-028bc99757f2" returned: 0 in 0.519s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-3b8adf91-a2f5-4ca8-8ab8-c4a34c239a70 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a4cda32-d7a2-4508-b55e-348ef80e69db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:35:24 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e119074d-8e9c-4634-b911-dca0b5b5d8af]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:35:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3b8adf91-a2f5-4ca8-8ab8-c4a34c239a70 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:24 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db Nov 02 15:35:24 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:24 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3b8adf91-a2f5-4ca8-8ab8-c4a34c239a70 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db" returned: 0 in 0.478s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3b8adf91-a2f5-4ca8-8ab8-c4a34c239a70 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db.1f1cf7bc-d6b7-47bd-9110-028bc99757f2 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:24 devstack sudo[95636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db.1f1cf7bc-d6b7-47bd-9110-028bc99757f2 Nov 02 15:35:24 devstack sudo[95636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:25 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-46a139b4-4e61-4996-b9bf-19cf17d93431 req-27d3730a-44ba-4c25-abaa-af8965c803c8 tempest-AttachVolumeNegativeTest-1941915072 None] Terminate volume connection completed successfully. Nov 02 15:35:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-46a139b4-4e61-4996-b9bf-19cf17d93431 req-27d3730a-44ba-4c25-abaa-af8965c803c8 tempest-AttachVolumeNegativeTest-1941915072 None] Deleting attachment 3832d1bb-38fd-41cb-9b2a-97c70b5e5341. {{(pid=86703) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 15:35:25 devstack sudo[95636]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:25 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:35:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] Flow 'volume_create_manager' (b152b79d-0f6b-4cee-8997-1937eb082e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:35:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c51354-8864-40f9-a86f-ac805b71fbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:35:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3b8adf91-a2f5-4ca8-8ab8-c4a34c239a70 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db.1f1cf7bc-d6b7-47bd-9110-028bc99757f2" returned: 0 in 0.626s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3b8adf91-a2f5-4ca8-8ab8-c4a34c239a70 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db.1f1cf7bc-d6b7-47bd-9110-028bc99757f2 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c51354-8864-40f9-a86f-ac805b71fbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-838595261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c83eb0bc-481f-424c-b501-03224b5a9f37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d17beb0c200497ea879f40f2fc37d0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:35:25Z,use_quota=True,user_id='5dd5546936854f22a35f6e84f961a6d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:35:25 devstack sudo[95645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db.1f1cf7bc-d6b7-47bd-9110-028bc99757f2 Nov 02 15:35:25 devstack sudo[95645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cceede2b-bc3c-4602-a104-820b34787a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:35:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cceede2b-bc3c-4602-a104-820b34787a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:35:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f423f26a-fd4a-4af9-b402-bdaf102edb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:35:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f423f26a-fd4a-4af9-b402-bdaf102edb10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c83eb0bc-481f-424c-b501-03224b5a9f37', 'volume_name': 'volume-c83eb0bc-481f-424c-b501-03224b5a9f37', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:35:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f899fa8-3134-4742-9a02-d0ecfab50c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:35:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f899fa8-3134-4742-9a02-d0ecfab50c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:35:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8de37a4a-29e8-498f-aced-8a21085d0718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:35:25 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] Volume c83eb0bc-481f-424c-b501-03224b5a9f37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c83eb0bc-481f-424c-b501-03224b5a9f37', 'volume_size': 1} Nov 02 15:35:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:35:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:35:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-838595261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c83eb0bc-481f-424c-b501-03224b5a9f37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d17beb0c200497ea879f40f2fc37d0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:35:25Z,use_quota=True,user_id='5dd5546936854f22a35f6e84f961a6d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:35:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] Creating volume c83eb0bc-481f-424c-b501-03224b5a9f37 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:35:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:35:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:35:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:35:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:35:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:35:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:35:25 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:35:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c83eb0bc-481f-424c-b501-03224b5a9f37 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:25 devstack sudo[95648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c83eb0bc-481f-424c-b501-03224b5a9f37 1073741824 Nov 02 15:35:25 devstack sudo[95648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:25 devstack sudo[95645]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3b8adf91-a2f5-4ca8-8ab8-c4a34c239a70 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db.1f1cf7bc-d6b7-47bd-9110-028bc99757f2" returned: 0 in 0.281s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:25 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3b8adf91-a2f5-4ca8-8ab8-c4a34c239a70 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Lock "cinder-quobyte-1f1cf7bc-d6b7-47bd-9110-028bc99757f2" released by "_delete_snapshot" :: held 2.099s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:35:25 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3b8adf91-a2f5-4ca8-8ab8-c4a34c239a70 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Lock "cinder-quobyte-3a4cda32-d7a2-4508-b55e-348ef80e69db" released by "delete_snapshot" :: held 2.134s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:35:26 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-3b8adf91-a2f5-4ca8-8ab8-c4a34c239a70 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Created reservations ['b6e354c7-e962-40bd-9dac-21d912ae568a', '7e911228-7d1a-4b73-b376-262e848f946b', '7911d6ae-fe22-41b6-8724-4de448fab7ee', 'a98ee809-c0f5-43de-bc4e-906c335da02c'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:35:26 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-3b8adf91-a2f5-4ca8-8ab8-c4a34c239a70 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Delete snapshot completed successfully. Nov 02 15:35:26 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3b8adf91-a2f5-4ca8-8ab8-c4a34c239a70 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Lock "cinder-1f1cf7bc-d6b7-47bd-9110-028bc99757f2-delete_snapshot" released by "delete_snapshot" :: held 2.379s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:35:26 devstack sudo[95648]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c83eb0bc-481f-424c-b501-03224b5a9f37 1073741824" returned: 0 in 0.635s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c83eb0bc-481f-424c-b501-03224b5a9f37 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:26 devstack sudo[95659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c83eb0bc-481f-424c-b501-03224b5a9f37 Nov 02 15:35:26 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:26 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c83eb0bc-481f-424c-b501-03224b5a9f37" returned: 0 in 0.400s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:35:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:35:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8de37a4a-29e8-498f-aced-8a21085d0718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c83eb0bc-481f-424c-b501-03224b5a9f37', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:35:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c2e7af9-d386-49f4-8747-b555c5d5ec68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:35:26 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] Volume volume-c83eb0bc-481f-424c-b501-03224b5a9f37 (c83eb0bc-481f-424c-b501-03224b5a9f37): created successfully Nov 02 15:35:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c2e7af9-d386-49f4-8747-b555c5d5ec68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:35:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] Flow 'volume_create_manager' (b152b79d-0f6b-4cee-8997-1937eb082e46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:35:26 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-f55fc342-e6ec-4077-8e04-0d93730a2bf5 tempest-VolumesServicesTestJSON-2082617675 None] Created volume successfully. Nov 02 15:35:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b4740c4b-cd73-4867-8739-fcfe002b1e76 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Acquiring lock "cinder-3a4cda32-d7a2-4508-b55e-348ef80e69db-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:35:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b4740c4b-cd73-4867-8739-fcfe002b1e76 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Lock "cinder-3a4cda32-d7a2-4508-b55e-348ef80e69db-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:35:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b4740c4b-cd73-4867-8739-fcfe002b1e76 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Acquiring lock "cinder-quobyte-3a4cda32-d7a2-4508-b55e-348ef80e69db" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:35:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b4740c4b-cd73-4867-8739-fcfe002b1e76 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Lock "cinder-quobyte-3a4cda32-d7a2-4508-b55e-348ef80e69db" acquired by "delete_volume" :: waited 0.029s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:35:27 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a931ac6b-12ad-4c37-9d61-e5e211cb3703]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:35:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b4740c4b-cd73-4867-8739-fcfe002b1e76 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:27 devstack sudo[95677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db Nov 02 15:35:27 devstack sudo[95677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:27 devstack sudo[95677]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b4740c4b-cd73-4867-8739-fcfe002b1e76 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db" returned: 0 in 0.411s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b4740c4b-cd73-4867-8739-fcfe002b1e76 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:27 devstack sudo[95683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db Nov 02 15:35:27 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-fc180c33-804d-4768-a998-3fee77c7d6c6 tempest-VolumesServicesTestJSON-2082617675 None] Acquiring lock "cinder-c83eb0bc-481f-424c-b501-03224b5a9f37-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:35:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-fc180c33-804d-4768-a998-3fee77c7d6c6 tempest-VolumesServicesTestJSON-2082617675 None] Lock "cinder-c83eb0bc-481f-424c-b501-03224b5a9f37-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:35:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-fc180c33-804d-4768-a998-3fee77c7d6c6 tempest-VolumesServicesTestJSON-2082617675 None] Acquiring lock "cinder-quobyte-c83eb0bc-481f-424c-b501-03224b5a9f37" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:35:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-fc180c33-804d-4768-a998-3fee77c7d6c6 tempest-VolumesServicesTestJSON-2082617675 None] Lock "cinder-quobyte-c83eb0bc-481f-424c-b501-03224b5a9f37" acquired by "delete_volume" :: waited 0.024s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:35:27 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d10f00-7556-43f3-ba77-56fc8f581755]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:35:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-fc180c33-804d-4768-a998-3fee77c7d6c6 tempest-VolumesServicesTestJSON-2082617675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c83eb0bc-481f-424c-b501-03224b5a9f37 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:27 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b4740c4b-cd73-4867-8739-fcfe002b1e76 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3a4cda32-d7a2-4508-b55e-348ef80e69db" returned: 0 in 0.293s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:28 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b4740c4b-cd73-4867-8739-fcfe002b1e76 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Lock "cinder-quobyte-3a4cda32-d7a2-4508-b55e-348ef80e69db" released by "delete_volume" :: held 0.816s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:35:28 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-b4740c4b-cd73-4867-8739-fcfe002b1e76 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Created reservations ['363fd39a-41cf-4026-8055-3442b0a080e7', '2c08fb47-b177-44e9-805f-5f860c873c88', 'a0c8bf56-780b-4d82-9816-46a2e030afde', '17d7dde9-1a4c-42c7-93e9-4caef2383a19'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:35:28 devstack sudo[95686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c83eb0bc-481f-424c-b501-03224b5a9f37 Nov 02 15:35:28 devstack sudo[95686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b4740c4b-cd73-4867-8739-fcfe002b1e76 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:35:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b4740c4b-cd73-4867-8739-fcfe002b1e76 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:35:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b4740c4b-cd73-4867-8739-fcfe002b1e76 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:35:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b4740c4b-cd73-4867-8739-fcfe002b1e76 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:35:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b4740c4b-cd73-4867-8739-fcfe002b1e76 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:35:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b4740c4b-cd73-4867-8739-fcfe002b1e76 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:28 devstack sudo[95688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:35:28 devstack sudo[95688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:28 devstack sudo[95688]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b4740c4b-cd73-4867-8739-fcfe002b1e76 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.348s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:28 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-b4740c4b-cd73-4867-8739-fcfe002b1e76 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:35:28 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-b4740c4b-cd73-4867-8739-fcfe002b1e76 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Deleted volume successfully. Nov 02 15:35:28 devstack sudo[95686]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-fc180c33-804d-4768-a998-3fee77c7d6c6 tempest-VolumesServicesTestJSON-2082617675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c83eb0bc-481f-424c-b501-03224b5a9f37" returned: 0 in 0.608s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-fc180c33-804d-4768-a998-3fee77c7d6c6 tempest-VolumesServicesTestJSON-2082617675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c83eb0bc-481f-424c-b501-03224b5a9f37 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:28 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b4740c4b-cd73-4867-8739-fcfe002b1e76 tempest-VolumesSnapshotNegativeTestJSON-772339606 None] Lock "cinder-3a4cda32-d7a2-4508-b55e-348ef80e69db-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:35:28 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c83eb0bc-481f-424c-b501-03224b5a9f37 Nov 02 15:35:28 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:28 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-fc180c33-804d-4768-a998-3fee77c7d6c6 tempest-VolumesServicesTestJSON-2082617675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c83eb0bc-481f-424c-b501-03224b5a9f37" returned: 0 in 0.389s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:28 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-fc180c33-804d-4768-a998-3fee77c7d6c6 tempest-VolumesServicesTestJSON-2082617675 None] Lock "cinder-quobyte-c83eb0bc-481f-424c-b501-03224b5a9f37" released by "delete_volume" :: held 1.074s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:35:29 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-fc180c33-804d-4768-a998-3fee77c7d6c6 tempest-VolumesServicesTestJSON-2082617675 None] Created reservations ['2ceee151-040a-422b-b2fe-11322b39bbb5', '2cc97918-d401-4715-96b9-57214daae429', 'c1a51e88-6ff9-4483-9555-b5797a364d4b', '99730679-9578-417d-a197-f586b83fb44b'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:35:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-fc180c33-804d-4768-a998-3fee77c7d6c6 tempest-VolumesServicesTestJSON-2082617675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:35:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-fc180c33-804d-4768-a998-3fee77c7d6c6 tempest-VolumesServicesTestJSON-2082617675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:35:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-fc180c33-804d-4768-a998-3fee77c7d6c6 tempest-VolumesServicesTestJSON-2082617675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:35:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-fc180c33-804d-4768-a998-3fee77c7d6c6 tempest-VolumesServicesTestJSON-2082617675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:35:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-fc180c33-804d-4768-a998-3fee77c7d6c6 tempest-VolumesServicesTestJSON-2082617675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:35:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-fc180c33-804d-4768-a998-3fee77c7d6c6 tempest-VolumesServicesTestJSON-2082617675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:35:29 devstack sudo[95698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:35:29 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:35:29 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root Nov 02 15:35:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-fc180c33-804d-4768-a998-3fee77c7d6c6 tempest-VolumesServicesTestJSON-2082617675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.352s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:35:29 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-fc180c33-804d-4768-a998-3fee77c7d6c6 tempest-VolumesServicesTestJSON-2082617675 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:35:29 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-fc180c33-804d-4768-a998-3fee77c7d6c6 tempest-VolumesServicesTestJSON-2082617675 None] Deleted volume successfully. Nov 02 15:35:29 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-fc180c33-804d-4768-a998-3fee77c7d6c6 tempest-VolumesServicesTestJSON-2082617675 None] Lock "cinder-c83eb0bc-481f-424c-b501-03224b5a9f37-delete_volume" released by "delete_volume" :: held 1.802s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:35:39 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=94,cinder:INSERT=24,cinder:UPDATE=110,cinder:DELETE=10 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:35:39 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=80,cinder:INSERT=33,cinder:UPDATE=113,cinder:DELETE=9 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:36:09 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:36:09 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] Flow 'volume_create_manager' (4ad3c3ac-131f-42ae-9997-1bee035d9a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:36:09 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dbc845d-87b2-4d3e-b9c3-7e2419f39b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:36:09 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dbc845d-87b2-4d3e-b9c3-7e2419f39b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1326078041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ec9e9e3-1388-4519-aaa8-eca75332bfaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45818e77032a43298a115c33b492062f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:36:09Z,use_quota=True,user_id='4eaf06d9598f495dbff2e39b3d9e6357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:36:09 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14825f7a-a089-4927-a358-dc7579d159b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:36:09 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14825f7a-a089-4927-a358-dc7579d159b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:36:09 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73126391-b804-4412-ba61-b7299694ff3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:36:09 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73126391-b804-4412-ba61-b7299694ff3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ec9e9e3-1388-4519-aaa8-eca75332bfaf', 'volume_name': 'volume-5ec9e9e3-1388-4519-aaa8-eca75332bfaf', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:36:09 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (321f0592-7aa7-4099-a46a-a1f643fbd808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:36:09 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (321f0592-7aa7-4099-a46a-a1f643fbd808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:36:09 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc7c858-cc0a-4200-9217-d6af305b3e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:36:09 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] Volume 5ec9e9e3-1388-4519-aaa8-eca75332bfaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ec9e9e3-1388-4519-aaa8-eca75332bfaf', 'volume_size': 1} Nov 02 15:36:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:36:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:36:09 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1326078041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ec9e9e3-1388-4519-aaa8-eca75332bfaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45818e77032a43298a115c33b492062f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:36:09Z,use_quota=True,user_id='4eaf06d9598f495dbff2e39b3d9e6357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:36:09 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] Creating volume 5ec9e9e3-1388-4519-aaa8-eca75332bfaf {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:36:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:36:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:36:09 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:36:09 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:36:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:36:09 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:36:09 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:36:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5ec9e9e3-1388-4519-aaa8-eca75332bfaf 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:36:09 devstack sudo[95928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5ec9e9e3-1388-4519-aaa8-eca75332bfaf 1073741824 Nov 02 15:36:09 devstack sudo[95928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:36:10 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:36:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] Flow 'volume_create_manager' (880b294c-17fc-4feb-82f4-7bf82dc01500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:36:10 devstack sudo[95928]: pam_unix(sudo:session): session closed for user root Nov 02 15:36:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b72c407-30a6-45a9-8167-ddf20fd8e19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:36:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5ec9e9e3-1388-4519-aaa8-eca75332bfaf 1073741824" returned: 0 in 1.703s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:36:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b72c407-30a6-45a9-8167-ddf20fd8e19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1852538972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b6d706a-d6f1-4656-b07f-8508dd50112b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45818e77032a43298a115c33b492062f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:36:11Z,use_quota=True,user_id='4eaf06d9598f495dbff2e39b3d9e6357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:36:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a9d692b-bbe7-4575-a382-5c035cce23ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:36:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a9d692b-bbe7-4575-a382-5c035cce23ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:36:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (632575ca-e904-4622-909c-b4f270dfa8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:36:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (632575ca-e904-4622-909c-b4f270dfa8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b6d706a-d6f1-4656-b07f-8508dd50112b', 'volume_name': 'volume-5b6d706a-d6f1-4656-b07f-8508dd50112b', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:36:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d80153-3d34-4fe0-b6d3-1e37445a50bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:36:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d80153-3d34-4fe0-b6d3-1e37445a50bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:36:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9584fe8b-c59f-4801-8ee1-7a92b7d17529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:36:11 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] Volume 5b6d706a-d6f1-4656-b07f-8508dd50112b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b6d706a-d6f1-4656-b07f-8508dd50112b', 'volume_size': 1} Nov 02 15:36:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:36:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5ec9e9e3-1388-4519-aaa8-eca75332bfaf {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:36:11 devstack sudo[95953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5ec9e9e3-1388-4519-aaa8-eca75332bfaf Nov 02 15:36:11 devstack sudo[95953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:36:11 devstack sudo[95953]: pam_unix(sudo:session): session closed for user root Nov 02 15:36:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5ec9e9e3-1388-4519-aaa8-eca75332bfaf" returned: 0 in 0.578s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:36:11 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] <== create_volume: return (2597ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:36:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.609s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:36:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.651s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:36:11 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1852538972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b6d706a-d6f1-4656-b07f-8508dd50112b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45818e77032a43298a115c33b492062f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:36:11Z,use_quota=True,user_id='4eaf06d9598f495dbff2e39b3d9e6357',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:36:11 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] Creating volume 5b6d706a-d6f1-4656-b07f-8508dd50112b {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:36:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:36:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:36:11 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:36:11 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:36:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:36:11 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:36:11 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:36:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5b6d706a-d6f1-4656-b07f-8508dd50112b 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:36:11 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5b6d706a-d6f1-4656-b07f-8508dd50112b 1073741824 Nov 02 15:36:11 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:36:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc7c858-cc0a-4200-9217-d6af305b3e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ec9e9e3-1388-4519-aaa8-eca75332bfaf', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:36:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426ab76b-66d7-40ed-b4a2-be3b7d23fbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:36:12 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] Volume volume-5ec9e9e3-1388-4519-aaa8-eca75332bfaf (5ec9e9e3-1388-4519-aaa8-eca75332bfaf): created successfully Nov 02 15:36:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (426ab76b-66d7-40ed-b4a2-be3b7d23fbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:36:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] Flow 'volume_create_manager' (4ad3c3ac-131f-42ae-9997-1bee035d9a78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:36:12 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-03e51264-194e-49d5-a0c6-f006e41fad39 tempest-TestServerVolumeAttachmentScenario-743055380 None] Created volume successfully. Nov 02 15:36:12 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Nov 02 15:36:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5b6d706a-d6f1-4656-b07f-8508dd50112b 1073741824" returned: 0 in 0.848s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:36:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5b6d706a-d6f1-4656-b07f-8508dd50112b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:36:12 devstack sudo[95991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5b6d706a-d6f1-4656-b07f-8508dd50112b Nov 02 15:36:12 devstack sudo[95991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:36:13 devstack sudo[95991]: pam_unix(sudo:session): session closed for user root Nov 02 15:36:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5b6d706a-d6f1-4656-b07f-8508dd50112b" returned: 0 in 0.266s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:36:13 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:36:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:36:13 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9584fe8b-c59f-4801-8ee1-7a92b7d17529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b6d706a-d6f1-4656-b07f-8508dd50112b', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:36:13 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d3a5e4a-cfe6-4a20-aea3-889226fe1c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:36:15 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] Volume volume-5b6d706a-d6f1-4656-b07f-8508dd50112b (5b6d706a-d6f1-4656-b07f-8508dd50112b): created successfully Nov 02 15:36:15 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d3a5e4a-cfe6-4a20-aea3-889226fe1c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:36:15 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] Flow 'volume_create_manager' (880b294c-17fc-4feb-82f4-7bf82dc01500) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:36:16 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-abe044a2-5290-41e5-9adc-772b80d47536 tempest-TestServerVolumeAttachmentScenario-743055380 None] Created volume successfully. Nov 02 15:36:20 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:36:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:36:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:36:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:36:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:36:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:36:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:36:20 devstack sudo[95996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:36:20 devstack sudo[95996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:36:20 devstack sudo[95996]: pam_unix(sudo:session): session closed for user root Nov 02 15:36:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.374s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:36:20 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:36:21 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager._thread_info {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:36:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread count: 29 {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 15:36:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread info: [<_MainThread(MainThread, started 125876361756800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 15:36:23 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:36:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] Flow 'volume_create_manager' (a27ad7a6-b3cb-4cc2-a78a-5c927f6d1b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:36:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bb2bc35-f5b0-4f61-ae4c-4aa3c89bb367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:36:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2bb2bc35-f5b0-4f61-ae4c-4aa3c89bb367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-174134254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68552a60-ad42-46f5-a4bd-bd20650d5d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a129d023d74ae690f617c854ba4c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:36:23Z,use_quota=True,user_id='d9797744c3544776ada81755252e15b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:36:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b30363e-e9c1-49f9-a632-d9d1512bbfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:36:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b30363e-e9c1-49f9-a632-d9d1512bbfeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:36:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9055c7d3-bf49-46f7-97f9-c01e6f55dc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:36:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9055c7d3-bf49-46f7-97f9-c01e6f55dc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68552a60-ad42-46f5-a4bd-bd20650d5d83', 'volume_name': 'volume-68552a60-ad42-46f5-a4bd-bd20650d5d83', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:36:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1228d5c-d02e-4172-9602-a21440f7cdd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:36:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1228d5c-d02e-4172-9602-a21440f7cdd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:36:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565ed97b-26a1-458f-95ce-e0e3ed2cc02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:36:23 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] Volume 68552a60-ad42-46f5-a4bd-bd20650d5d83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68552a60-ad42-46f5-a4bd-bd20650d5d83', 'volume_size': 1} Nov 02 15:36:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:36:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:36:23 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-174134254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68552a60-ad42-46f5-a4bd-bd20650d5d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a129d023d74ae690f617c854ba4c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:36:23Z,use_quota=True,user_id='d9797744c3544776ada81755252e15b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:36:23 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] Creating volume 68552a60-ad42-46f5-a4bd-bd20650d5d83 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:36:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:36:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:36:23 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:36:23 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:36:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:36:23 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:36:23 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:36:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68552a60-ad42-46f5-a4bd-bd20650d5d83 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:36:23 devstack sudo[96007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68552a60-ad42-46f5-a4bd-bd20650d5d83 1073741824 Nov 02 15:36:23 devstack sudo[96007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:36:24 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:36:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] Flow 'volume_create_manager' (12b81ce8-ed41-4f4c-851a-6f69336dd7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:36:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98a9ba30-d95a-414e-ac98-b1d94b8df86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:36:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98a9ba30-d95a-414e-ac98-b1d94b8df86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-286645714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=745368ef-a593-49fc-bcf9-01fafdb258bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79db8ca55de0489faae69e2fadd20ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:36:24Z,use_quota=True,user_id='22c2229482624c3bb08f464d425b1eef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:36:24 devstack sudo[96007]: pam_unix(sudo:session): session closed for user root Nov 02 15:36:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6d0379-92b0-4aae-b3f6-beab9efd2a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:36:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6d0379-92b0-4aae-b3f6-beab9efd2a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:36:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a992af19-45dc-401f-ad8f-7afc417a221b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:36:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a992af19-45dc-401f-ad8f-7afc417a221b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '745368ef-a593-49fc-bcf9-01fafdb258bc', 'volume_name': 'volume-745368ef-a593-49fc-bcf9-01fafdb258bc', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:36:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (349418ae-b68d-4957-b05a-e7a94d068131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:36:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (349418ae-b68d-4957-b05a-e7a94d068131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:36:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2697c91-535b-4ba4-af47-f827b65245ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:36:24 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] Volume 745368ef-a593-49fc-bcf9-01fafdb258bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-745368ef-a593-49fc-bcf9-01fafdb258bc', 'volume_size': 1} Nov 02 15:36:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:36:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68552a60-ad42-46f5-a4bd-bd20650d5d83 1073741824" returned: 0 in 0.805s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:36:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68552a60-ad42-46f5-a4bd-bd20650d5d83 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:36:24 devstack sudo[96027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68552a60-ad42-46f5-a4bd-bd20650d5d83 Nov 02 15:36:24 devstack sudo[96027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:36:24 devstack sudo[96027]: pam_unix(sudo:session): session closed for user root Nov 02 15:36:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68552a60-ad42-46f5-a4bd-bd20650d5d83" returned: 0 in 0.309s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:36:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:36:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:36:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.357s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:36:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-286645714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=745368ef-a593-49fc-bcf9-01fafdb258bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79db8ca55de0489faae69e2fadd20ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:36:24Z,use_quota=True,user_id='22c2229482624c3bb08f464d425b1eef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:36:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] Creating volume 745368ef-a593-49fc-bcf9-01fafdb258bc {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:36:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:36:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:36:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:36:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:36:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:36:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:36:24 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:36:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-745368ef-a593-49fc-bcf9-01fafdb258bc 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:36:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (565ed97b-26a1-458f-95ce-e0e3ed2cc02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68552a60-ad42-46f5-a4bd-bd20650d5d83', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:36:24 devstack sudo[96030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-745368ef-a593-49fc-bcf9-01fafdb258bc 1073741824 Nov 02 15:36:24 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:36:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f226f20e-ee84-4077-b525-caedf48046a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:36:24 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] Volume volume-68552a60-ad42-46f5-a4bd-bd20650d5d83 (68552a60-ad42-46f5-a4bd-bd20650d5d83): created successfully Nov 02 15:36:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f226f20e-ee84-4077-b525-caedf48046a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:36:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] Flow 'volume_create_manager' (a27ad7a6-b3cb-4cc2-a78a-5c927f6d1b12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:36:24 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-ca0ae57c-b9c1-4ce7-a7f7-3576f1825bc6 tempest-AttachVolumeNegativeTest-1941915072 None] Created volume successfully. Nov 02 15:36:25 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root Nov 02 15:36:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-745368ef-a593-49fc-bcf9-01fafdb258bc 1073741824" returned: 0 in 0.624s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:36:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-745368ef-a593-49fc-bcf9-01fafdb258bc {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:36:25 devstack sudo[96036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-745368ef-a593-49fc-bcf9-01fafdb258bc Nov 02 15:36:25 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:36:25 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root Nov 02 15:36:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-745368ef-a593-49fc-bcf9-01fafdb258bc" returned: 0 in 0.439s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:36:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:36:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:36:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2697c91-535b-4ba4-af47-f827b65245ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-745368ef-a593-49fc-bcf9-01fafdb258bc', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:36:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed4850a-6fd4-4ddb-a48e-65d033a6e070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:36:25 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] Volume volume-745368ef-a593-49fc-bcf9-01fafdb258bc (745368ef-a593-49fc-bcf9-01fafdb258bc): created successfully Nov 02 15:36:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed4850a-6fd4-4ddb-a48e-65d033a6e070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:36:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] Flow 'volume_create_manager' (12b81ce8-ed41-4f4c-851a-6f69336dd7ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:36:25 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-bfe16005-1a6f-40f9-9285-15e995c00933 tempest-AttachVolumeShelveTestJSON-45132328 None] Created volume successfully. Nov 02 15:36:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-650a5095-fbc7-4f38-8529-71e27506da71 req-b3a6c6ac-e6d2-45b4-ac2b-ede527e67cc2 tempest-AttachVolumeNegativeTest-1941915072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:36:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-650a5095-fbc7-4f38-8529-71e27506da71 req-b3a6c6ac-e6d2-45b4-ac2b-ede527e67cc2 tempest-AttachVolumeNegativeTest-1941915072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:36:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-650a5095-fbc7-4f38-8529-71e27506da71 req-b3a6c6ac-e6d2-45b4-ac2b-ede527e67cc2 tempest-AttachVolumeNegativeTest-1941915072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:36:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-650a5095-fbc7-4f38-8529-71e27506da71 req-b3a6c6ac-e6d2-45b4-ac2b-ede527e67cc2 tempest-AttachVolumeNegativeTest-1941915072 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478', 'name': 'volume-68552a60-ad42-46f5-a4bd-bd20650d5d83', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '18845288-40fa-4ccf-921d-16d7632a90ed', 'enforce_multipath': True} {{(pid=86703) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 15:36:26 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-650a5095-fbc7-4f38-8529-71e27506da71 req-b3a6c6ac-e6d2-45b4-ac2b-ede527e67cc2 tempest-AttachVolumeNegativeTest-1941915072 None] attachment_update completed successfully. Nov 02 15:36:31 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-4b5ef68d-5d79-4003-8620-467b7c8f5d03 req-cf186ac6-c767-4eac-9f9c-5e7d3d936bb9 tempest-AttachVolumeNegativeTest-1941915072 None] Terminate volume connection completed successfully. Nov 02 15:36:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-4b5ef68d-5d79-4003-8620-467b7c8f5d03 req-cf186ac6-c767-4eac-9f9c-5e7d3d936bb9 tempest-AttachVolumeNegativeTest-1941915072 None] Deleting attachment 18845288-40fa-4ccf-921d-16d7632a90ed. {{(pid=86703) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 15:36:41 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=15,cinder:UPDATE=15,cinder:INSERT=2,cinder:DELETE=3 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:36:41 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=17,cinder:UPDATE=13,cinder:DELETE=1,cinder:INSERT=2 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:36:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-721a77c3-5103-4a4e-8520-0ea8c1baa8d8 req-e4432174-ba53-4962-be15-a6b1ca3a2fb7 tempest-AttachVolumeShelveTestJSON-45132328 None] No connector for attachment 16212969-f5ad-4dcf-9c4e-9f04f99cd771; skipping storage backend terminate_connection call. {{(pid=86703) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 02 15:36:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-721a77c3-5103-4a4e-8520-0ea8c1baa8d8 req-e4432174-ba53-4962-be15-a6b1ca3a2fb7 tempest-AttachVolumeShelveTestJSON-45132328 None] Deleting attachment 16212969-f5ad-4dcf-9c4e-9f04f99cd771. {{(pid=86703) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 15:36:59 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=2 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:37:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-bdfccd20-2895-47f7-a88e-5df61e6f3269 req-6cce45cf-7e9d-4c29-a7ea-d170e1df586c tempest-TestServerVolumeAttachmentScenario-743055380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:37:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-bdfccd20-2895-47f7-a88e-5df61e6f3269 req-6cce45cf-7e9d-4c29-a7ea-d170e1df586c tempest-TestServerVolumeAttachmentScenario-743055380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:37:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-bdfccd20-2895-47f7-a88e-5df61e6f3269 req-6cce45cf-7e9d-4c29-a7ea-d170e1df586c tempest-TestServerVolumeAttachmentScenario-743055380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:37:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-bdfccd20-2895-47f7-a88e-5df61e6f3269 req-6cce45cf-7e9d-4c29-a7ea-d170e1df586c tempest-TestServerVolumeAttachmentScenario-743055380 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478', 'name': 'volume-5ec9e9e3-1388-4519-aaa8-eca75332bfaf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f66853a1-79a3-4261-b186-c5ba054e187d', 'enforce_multipath': True} {{(pid=86703) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 15:37:00 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-bdfccd20-2895-47f7-a88e-5df61e6f3269 req-6cce45cf-7e9d-4c29-a7ea-d170e1df586c tempest-TestServerVolumeAttachmentScenario-743055380 None] attachment_update completed successfully. Nov 02 15:37:02 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:37:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] Flow 'volume_create_manager' (721478af-c896-4b0b-a1d7-d99c4700c457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:37:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b534f74-5b50-4118-98ad-929dc54bc193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b534f74-5b50-4118-98ad-929dc54bc193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-279234963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aadea2a8-dda9-450a-8de7-df11050112ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ce45fff2fb421381489b85e3fa993e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:37:03Z,use_quota=True,user_id='cc7281b883e94f48b6bf1de0bbbc52f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c23d8b-7b9a-41c2-9205-4143d3fc3e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c23d8b-7b9a-41c2-9205-4143d3fc3e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c9fec6-cdd4-4431-9e3d-e3325c8948ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c9fec6-cdd4-4431-9e3d-e3325c8948ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aadea2a8-dda9-450a-8de7-df11050112ce', 'volume_name': 'volume-aadea2a8-dda9-450a-8de7-df11050112ce', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3af205b-735f-4a08-8e9c-63b5cb6188ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3af205b-735f-4a08-8e9c-63b5cb6188ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9537c68c-74a4-44a6-a96f-3cb76ecb9546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:02 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] Volume aadea2a8-dda9-450a-8de7-df11050112ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aadea2a8-dda9-450a-8de7-df11050112ce', 'volume_size': 1} Nov 02 15:37:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:37:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:37:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-279234963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aadea2a8-dda9-450a-8de7-df11050112ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ce45fff2fb421381489b85e3fa993e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:37:03Z,use_quota=True,user_id='cc7281b883e94f48b6bf1de0bbbc52f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:37:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] Creating volume aadea2a8-dda9-450a-8de7-df11050112ce {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:37:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:37:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:37:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:37:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:37:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:37:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:37:02 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:37:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-aadea2a8-dda9-450a-8de7-df11050112ce 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:03 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-aadea2a8-dda9-450a-8de7-df11050112ce 1073741824 Nov 02 15:37:03 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:04 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-aadea2a8-dda9-450a-8de7-df11050112ce 1073741824" returned: 0 in 1.200s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-aadea2a8-dda9-450a-8de7-df11050112ce {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:04 devstack sudo[97340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-aadea2a8-dda9-450a-8de7-df11050112ce Nov 02 15:37:04 devstack sudo[97340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:04 devstack sudo[97340]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-aadea2a8-dda9-450a-8de7-df11050112ce" returned: 0 in 0.728s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:05 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] <== create_volume: return (2022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:37:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.024s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:37:05 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9537c68c-74a4-44a6-a96f-3cb76ecb9546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aadea2a8-dda9-450a-8de7-df11050112ce', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:05 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (857c79f7-885a-4a30-bd2d-f3a2a755b54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:05 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] Volume volume-aadea2a8-dda9-450a-8de7-df11050112ce (aadea2a8-dda9-450a-8de7-df11050112ce): created successfully Nov 02 15:37:05 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (857c79f7-885a-4a30-bd2d-f3a2a755b54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:05 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] Flow 'volume_create_manager' (721478af-c896-4b0b-a1d7-d99c4700c457) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:37:05 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-ec50dd8f-2049-4518-b5cc-dbbcce2169fe tempest-VolumesActionsTest-2019714403 None] Created volume successfully. Nov 02 15:37:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-990105d5-0240-4f50-bb76-ca51548bc1d1 tempest-VolumesActionsTest-2019714403 None] Acquiring lock "cinder-aadea2a8-dda9-450a-8de7-df11050112ce" by "attach_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:37:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-990105d5-0240-4f50-bb76-ca51548bc1d1 tempest-VolumesActionsTest-2019714403 None] Lock "cinder-aadea2a8-dda9-450a-8de7-df11050112ce" acquired by "attach_volume" :: waited 0.078s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:37:06 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-990105d5-0240-4f50-bb76-ca51548bc1d1 tempest-VolumesActionsTest-2019714403 None] Attaching volume aadea2a8-dda9-450a-8de7-df11050112ce to instance b234cfa4-c657-4063-b9f6-582a63d884a3 at mountpoint /dev/vdb on host None. Nov 02 15:37:06 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-990105d5-0240-4f50-bb76-ca51548bc1d1 tempest-VolumesActionsTest-2019714403 None] Attach volume completed successfully. Nov 02 15:37:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-990105d5-0240-4f50-bb76-ca51548bc1d1 tempest-VolumesActionsTest-2019714403 None] Lock "cinder-aadea2a8-dda9-450a-8de7-df11050112ce" released by "attach_volume" :: held 0.412s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:37:08 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-57eb2ef9-d7c6-44fa-ac38-3d74e98ee261 tempest-VolumesActionsTest-110662849 None] Terminate volume connection completed successfully. Nov 02 15:37:08 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-57eb2ef9-d7c6-44fa-ac38-3d74e98ee261 tempest-VolumesActionsTest-110662849 None] Acquiring lock "cinder-aadea2a8-dda9-450a-8de7-df11050112ce-detach_volume" by "detach_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:37:08 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-57eb2ef9-d7c6-44fa-ac38-3d74e98ee261 tempest-VolumesActionsTest-110662849 None] Lock "cinder-aadea2a8-dda9-450a-8de7-df11050112ce-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:37:08 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-57eb2ef9-d7c6-44fa-ac38-3d74e98ee261 tempest-VolumesActionsTest-110662849 None] Detaching volume aadea2a8-dda9-450a-8de7-df11050112ce from instance b234cfa4-c657-4063-b9f6-582a63d884a3. Nov 02 15:37:08 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-57eb2ef9-d7c6-44fa-ac38-3d74e98ee261 tempest-VolumesActionsTest-110662849 None] Detach volume completed successfully. Nov 02 15:37:08 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-57eb2ef9-d7c6-44fa-ac38-3d74e98ee261 tempest-VolumesActionsTest-110662849 None] Lock "cinder-aadea2a8-dda9-450a-8de7-df11050112ce-detach_volume" released by "detach_volume" :: held 0.191s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:37:09 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-063e7651-02e8-4d3d-a149-817838708f23 tempest-VolumesActionsTest-2019714403 None] Acquiring lock "cinder-aadea2a8-dda9-450a-8de7-df11050112ce-detach_volume" by "detach_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:37:09 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-063e7651-02e8-4d3d-a149-817838708f23 tempest-VolumesActionsTest-2019714403 None] Lock "cinder-aadea2a8-dda9-450a-8de7-df11050112ce-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:37:09 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-063e7651-02e8-4d3d-a149-817838708f23 tempest-VolumesActionsTest-2019714403 None] Volume detach called, but volume not attached. Nov 02 15:37:09 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-063e7651-02e8-4d3d-a149-817838708f23 tempest-VolumesActionsTest-2019714403 None] Lock "cinder-aadea2a8-dda9-450a-8de7-df11050112ce-detach_volume" released by "detach_volume" :: held 0.038s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:37:09 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8d256dd9-f7e2-46b9-af72-4f83ab652291 tempest-VolumesActionsTest-2019714403 None] Acquiring lock "cinder-aadea2a8-dda9-450a-8de7-df11050112ce-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:37:09 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8d256dd9-f7e2-46b9-af72-4f83ab652291 tempest-VolumesActionsTest-2019714403 None] Lock "cinder-aadea2a8-dda9-450a-8de7-df11050112ce-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:37:10 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8d256dd9-f7e2-46b9-af72-4f83ab652291 tempest-VolumesActionsTest-2019714403 None] Acquiring lock "cinder-quobyte-aadea2a8-dda9-450a-8de7-df11050112ce" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:37:10 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8d256dd9-f7e2-46b9-af72-4f83ab652291 tempest-VolumesActionsTest-2019714403 None] Lock "cinder-quobyte-aadea2a8-dda9-450a-8de7-df11050112ce" acquired by "delete_volume" :: waited 0.057s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:37:10 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40ea50e-6e7b-4fae-b89e-0c031da97da9]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:37:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8d256dd9-f7e2-46b9-af72-4f83ab652291 tempest-VolumesActionsTest-2019714403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-aadea2a8-dda9-450a-8de7-df11050112ce {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:10 devstack sudo[97414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-aadea2a8-dda9-450a-8de7-df11050112ce Nov 02 15:37:10 devstack sudo[97414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:10 devstack sudo[97414]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8d256dd9-f7e2-46b9-af72-4f83ab652291 tempest-VolumesActionsTest-2019714403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-aadea2a8-dda9-450a-8de7-df11050112ce" returned: 0 in 0.830s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8d256dd9-f7e2-46b9-af72-4f83ab652291 tempest-VolumesActionsTest-2019714403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-aadea2a8-dda9-450a-8de7-df11050112ce {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-2355872b-736e-45b1-96e1-d230dfd283da req-0a849d50-ac61-4574-be0d-570fd44f4585 tempest-TestServerVolumeAttachmentScenario-743055380 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:37:11 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-aadea2a8-dda9-450a-8de7-df11050112ce Nov 02 15:37:11 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-2355872b-736e-45b1-96e1-d230dfd283da req-0a849d50-ac61-4574-be0d-570fd44f4585 tempest-TestServerVolumeAttachmentScenario-743055380 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:37:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-2355872b-736e-45b1-96e1-d230dfd283da req-0a849d50-ac61-4574-be0d-570fd44f4585 tempest-TestServerVolumeAttachmentScenario-743055380 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:37:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-2355872b-736e-45b1-96e1-d230dfd283da req-0a849d50-ac61-4574-be0d-570fd44f4585 tempest-TestServerVolumeAttachmentScenario-743055380 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478', 'name': 'volume-5b6d706a-d6f1-4656-b07f-8508dd50112b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7a656803-e629-4b4f-bc37-7f416fa7297c', 'enforce_multipath': True} {{(pid=86703) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 15:37:11 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-2355872b-736e-45b1-96e1-d230dfd283da req-0a849d50-ac61-4574-be0d-570fd44f4585 tempest-TestServerVolumeAttachmentScenario-743055380 None] attachment_update completed successfully. Nov 02 15:37:11 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8d256dd9-f7e2-46b9-af72-4f83ab652291 tempest-VolumesActionsTest-2019714403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-aadea2a8-dda9-450a-8de7-df11050112ce" returned: 0 in 0.478s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:11 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8d256dd9-f7e2-46b9-af72-4f83ab652291 tempest-VolumesActionsTest-2019714403 None] Lock "cinder-quobyte-aadea2a8-dda9-450a-8de7-df11050112ce" released by "delete_volume" :: held 1.408s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:37:11 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-8d256dd9-f7e2-46b9-af72-4f83ab652291 tempest-VolumesActionsTest-2019714403 None] Created reservations ['f5c9e2e5-5a95-4166-a1d6-82b6556459ed', 'd572b4ec-ed9d-4fdf-b3bb-b09673b07cb6', '42602f59-c089-445f-bfee-ef809259c0e7', '58fe9087-5a5e-43ae-a92c-57739c51ac9e'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:37:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8d256dd9-f7e2-46b9-af72-4f83ab652291 tempest-VolumesActionsTest-2019714403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:37:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8d256dd9-f7e2-46b9-af72-4f83ab652291 tempest-VolumesActionsTest-2019714403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:37:11 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8d256dd9-f7e2-46b9-af72-4f83ab652291 tempest-VolumesActionsTest-2019714403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:37:11 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8d256dd9-f7e2-46b9-af72-4f83ab652291 tempest-VolumesActionsTest-2019714403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:37:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8d256dd9-f7e2-46b9-af72-4f83ab652291 tempest-VolumesActionsTest-2019714403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:37:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8d256dd9-f7e2-46b9-af72-4f83ab652291 tempest-VolumesActionsTest-2019714403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:11 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:37:11 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:12 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8d256dd9-f7e2-46b9-af72-4f83ab652291 tempest-VolumesActionsTest-2019714403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.525s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:12 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-8d256dd9-f7e2-46b9-af72-4f83ab652291 tempest-VolumesActionsTest-2019714403 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:37:12 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-8d256dd9-f7e2-46b9-af72-4f83ab652291 tempest-VolumesActionsTest-2019714403 None] Deleted volume successfully. Nov 02 15:37:12 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8d256dd9-f7e2-46b9-af72-4f83ab652291 tempest-VolumesActionsTest-2019714403 None] Lock "cinder-aadea2a8-dda9-450a-8de7-df11050112ce-delete_volume" released by "delete_volume" :: held 2.641s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:37:14 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-820c94d8-fd9a-4e3f-8bfb-fa5691303920 req-1b41f732-1c1d-4e59-90ff-77818dd80539 tempest-TestServerVolumeAttachmentScenario-743055380 None] Terminate volume connection completed successfully. Nov 02 15:37:14 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-820c94d8-fd9a-4e3f-8bfb-fa5691303920 req-1b41f732-1c1d-4e59-90ff-77818dd80539 tempest-TestServerVolumeAttachmentScenario-743055380 None] Deleting attachment 7a656803-e629-4b4f-bc37-7f416fa7297c. {{(pid=86703) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 15:37:18 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-d71c69bb-2634-430d-b991-113eca246d66 req-f4af6e0c-1e8f-4b1b-812a-55124f6d0f66 tempest-TestServerVolumeAttachmentScenario-743055380 None] Terminate volume connection completed successfully. Nov 02 15:37:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-d71c69bb-2634-430d-b991-113eca246d66 req-f4af6e0c-1e8f-4b1b-812a-55124f6d0f66 tempest-TestServerVolumeAttachmentScenario-743055380 None] Deleting attachment f66853a1-79a3-4261-b186-c5ba054e187d. {{(pid=86703) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 15:37:20 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:37:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] Flow 'volume_create_manager' (f8786577-ec7b-4f4f-99f9-d2c0ee86041f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:37:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80aa9218-66a3-429e-8951-2534cd94fbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80aa9218-66a3-429e-8951-2534cd94fbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-457716634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4091428-5fc8-466b-868f-d4f889641c72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ce45fff2fb421381489b85e3fa993e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:37:20Z,use_quota=True,user_id='cc7281b883e94f48b6bf1de0bbbc52f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb47e79c-085c-4b40-acb4-9879c610d0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb47e79c-085c-4b40-acb4-9879c610d0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3120d8-8e2c-4103-837c-ac9e986a8cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3120d8-8e2c-4103-837c-ac9e986a8cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4091428-5fc8-466b-868f-d4f889641c72', 'volume_name': 'volume-d4091428-5fc8-466b-868f-d4f889641c72', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a765918-b958-4d16-941f-f3800c99b083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a765918-b958-4d16-941f-f3800c99b083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21b2eba2-19ad-4db1-9260-15af593eb48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:20 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] Volume d4091428-5fc8-466b-868f-d4f889641c72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4091428-5fc8-466b-868f-d4f889641c72', 'volume_size': 1} Nov 02 15:37:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:37:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:37:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-457716634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4091428-5fc8-466b-868f-d4f889641c72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ce45fff2fb421381489b85e3fa993e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:37:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:37:20Z,use_quota=True,user_id='cc7281b883e94f48b6bf1de0bbbc52f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:37:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] Creating volume d4091428-5fc8-466b-868f-d4f889641c72 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:37:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:37:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:37:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:37:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:37:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:37:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:37:20 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:37:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4091428-5fc8-466b-868f-d4f889641c72 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:20 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:37:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:37:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:37:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:37:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:37:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:37:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:20 devstack sudo[97579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4091428-5fc8-466b-868f-d4f889641c72 1073741824 Nov 02 15:37:20 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:20 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:37:20 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:21 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.607s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:21 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:37:21 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager._thread_info {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:37:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread count: 29 {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 15:37:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread info: [<_MainThread(MainThread, started 125876361756800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 15:37:21 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4091428-5fc8-466b-868f-d4f889641c72 1073741824" returned: 0 in 0.902s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4091428-5fc8-466b-868f-d4f889641c72 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:21 devstack sudo[97606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4091428-5fc8-466b-868f-d4f889641c72 Nov 02 15:37:21 devstack sudo[97606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:21 devstack sudo[97606]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4091428-5fc8-466b-868f-d4f889641c72" returned: 0 in 0.339s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:21 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:37:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:37:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21b2eba2-19ad-4db1-9260-15af593eb48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4091428-5fc8-466b-868f-d4f889641c72', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb043302-f8fd-42ac-88c4-047c76ebbfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:21 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] Volume volume-d4091428-5fc8-466b-868f-d4f889641c72 (d4091428-5fc8-466b-868f-d4f889641c72): created successfully Nov 02 15:37:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb043302-f8fd-42ac-88c4-047c76ebbfe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] Flow 'volume_create_manager' (f8786577-ec7b-4f4f-99f9-d2c0ee86041f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:37:21 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-5fa6cdac-59d1-4acb-b9c3-85197c4b65cc tempest-VolumesActionsTest-2019714403 None] Created volume successfully. Nov 02 15:37:22 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ae26c93e-2929-4cee-a112-9fb669e65896 tempest-VolumesActionsTest-110662849 None] Acquiring lock "cinder-d4091428-5fc8-466b-868f-d4f889641c72-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:37:22 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ae26c93e-2929-4cee-a112-9fb669e65896 tempest-VolumesActionsTest-110662849 None] Lock "cinder-d4091428-5fc8-466b-868f-d4f889641c72-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:37:22 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ae26c93e-2929-4cee-a112-9fb669e65896 tempest-VolumesActionsTest-110662849 None] Acquiring lock "cinder-quobyte-d4091428-5fc8-466b-868f-d4f889641c72" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:37:22 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ae26c93e-2929-4cee-a112-9fb669e65896 tempest-VolumesActionsTest-110662849 None] Lock "cinder-quobyte-d4091428-5fc8-466b-868f-d4f889641c72" acquired by "delete_volume" :: waited 0.014s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:37:22 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a287bf-07ab-43d0-afe1-64256dd4f8c2]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:37:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ae26c93e-2929-4cee-a112-9fb669e65896 tempest-VolumesActionsTest-110662849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4091428-5fc8-466b-868f-d4f889641c72 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:23 devstack sudo[97614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4091428-5fc8-466b-868f-d4f889641c72 Nov 02 15:37:23 devstack sudo[97614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:23 devstack sudo[97614]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ae26c93e-2929-4cee-a112-9fb669e65896 tempest-VolumesActionsTest-110662849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4091428-5fc8-466b-868f-d4f889641c72" returned: 0 in 0.392s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ae26c93e-2929-4cee-a112-9fb669e65896 tempest-VolumesActionsTest-110662849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4091428-5fc8-466b-868f-d4f889641c72 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:23 devstack sudo[97619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4091428-5fc8-466b-868f-d4f889641c72 Nov 02 15:37:23 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:23 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ae26c93e-2929-4cee-a112-9fb669e65896 tempest-VolumesActionsTest-110662849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4091428-5fc8-466b-868f-d4f889641c72" returned: 0 in 0.270s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:23 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ae26c93e-2929-4cee-a112-9fb669e65896 tempest-VolumesActionsTest-110662849 None] Lock "cinder-quobyte-d4091428-5fc8-466b-868f-d4f889641c72" released by "delete_volume" :: held 0.728s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:37:23 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-ae26c93e-2929-4cee-a112-9fb669e65896 tempest-VolumesActionsTest-110662849 None] Created reservations ['aa9d0c59-5b0f-4643-9b84-d4eb67a80e9c', 'ff9170ea-1666-464b-8c6d-070bebaefcec', 'ec63d2e2-aacd-428e-9949-b6e9271ad131', '2af5176f-f07f-49fe-bfec-43230818682e'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:37:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ae26c93e-2929-4cee-a112-9fb669e65896 tempest-VolumesActionsTest-110662849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:37:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ae26c93e-2929-4cee-a112-9fb669e65896 tempest-VolumesActionsTest-110662849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:37:23 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ae26c93e-2929-4cee-a112-9fb669e65896 tempest-VolumesActionsTest-110662849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:37:23 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ae26c93e-2929-4cee-a112-9fb669e65896 tempest-VolumesActionsTest-110662849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:37:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ae26c93e-2929-4cee-a112-9fb669e65896 tempest-VolumesActionsTest-110662849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:37:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ae26c93e-2929-4cee-a112-9fb669e65896 tempest-VolumesActionsTest-110662849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:23 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:37:23 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:24 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ae26c93e-2929-4cee-a112-9fb669e65896 tempest-VolumesActionsTest-110662849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.272s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:24 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-ae26c93e-2929-4cee-a112-9fb669e65896 tempest-VolumesActionsTest-110662849 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:37:24 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-ae26c93e-2929-4cee-a112-9fb669e65896 tempest-VolumesActionsTest-110662849 None] Deleted volume successfully. Nov 02 15:37:24 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ae26c93e-2929-4cee-a112-9fb669e65896 tempest-VolumesActionsTest-110662849 None] Lock "cinder-d4091428-5fc8-466b-868f-d4f889641c72-delete_volume" released by "delete_volume" :: held 1.249s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:37:24 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-2b213ff7-cf8a-4914-8a7c-5688c39309ac tempest-TestServerVolumeAttachmentScenario-743055380 None] Acquiring lock "cinder-5b6d706a-d6f1-4656-b07f-8508dd50112b-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:37:24 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-2b213ff7-cf8a-4914-8a7c-5688c39309ac tempest-TestServerVolumeAttachmentScenario-743055380 None] Lock "cinder-5b6d706a-d6f1-4656-b07f-8508dd50112b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:37:24 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-2b213ff7-cf8a-4914-8a7c-5688c39309ac tempest-TestServerVolumeAttachmentScenario-743055380 None] Acquiring lock "cinder-quobyte-5b6d706a-d6f1-4656-b07f-8508dd50112b" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:37:24 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-2b213ff7-cf8a-4914-8a7c-5688c39309ac tempest-TestServerVolumeAttachmentScenario-743055380 None] Lock "cinder-quobyte-5b6d706a-d6f1-4656-b07f-8508dd50112b" acquired by "delete_volume" :: waited 0.017s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:37:24 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[679f4587-6e6a-403f-bfc5-1f92f4fd0aca]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:37:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2b213ff7-cf8a-4914-8a7c-5688c39309ac tempest-TestServerVolumeAttachmentScenario-743055380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5b6d706a-d6f1-4656-b07f-8508dd50112b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:24 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5b6d706a-d6f1-4656-b07f-8508dd50112b Nov 02 15:37:24 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:24 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:37:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] Flow 'volume_create_manager' (c3ea4e46-510a-4f21-abaa-2911c6309879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:37:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a03b4e5-e22b-4957-873a-e8e1b5e75084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a03b4e5-e22b-4957-873a-e8e1b5e75084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1562012951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c704621-943d-4fbf-be36-291824b7c143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ce45fff2fb421381489b85e3fa993e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:37:25Z,use_quota=True,user_id='cc7281b883e94f48b6bf1de0bbbc52f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa225d8-6b22-45a2-bf35-773379d4eb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa225d8-6b22-45a2-bf35-773379d4eb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df15630-1d99-4bab-92c1-3969078de009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2df15630-1d99-4bab-92c1-3969078de009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c704621-943d-4fbf-be36-291824b7c143', 'volume_name': 'volume-1c704621-943d-4fbf-be36-291824b7c143', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a09df87-a59c-4274-8e5e-c766f95e2210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a09df87-a59c-4274-8e5e-c766f95e2210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1950d04f-39ee-4b71-ab16-3eb2bc92c478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:24 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] Volume 1c704621-943d-4fbf-be36-291824b7c143: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c704621-943d-4fbf-be36-291824b7c143', 'volume_size': 1} Nov 02 15:37:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:37:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:37:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1562012951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c704621-943d-4fbf-be36-291824b7c143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ce45fff2fb421381489b85e3fa993e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:37:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:37:25Z,use_quota=True,user_id='cc7281b883e94f48b6bf1de0bbbc52f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:37:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] Creating volume 1c704621-943d-4fbf-be36-291824b7c143 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:37:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:37:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:37:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:37:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:37:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:37:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:37:24 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:37:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1c704621-943d-4fbf-be36-291824b7c143 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:24 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1c704621-943d-4fbf-be36-291824b7c143 1073741824 Nov 02 15:37:24 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:24 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2b213ff7-cf8a-4914-8a7c-5688c39309ac tempest-TestServerVolumeAttachmentScenario-743055380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5b6d706a-d6f1-4656-b07f-8508dd50112b" returned: 0 in 0.442s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2b213ff7-cf8a-4914-8a7c-5688c39309ac tempest-TestServerVolumeAttachmentScenario-743055380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5b6d706a-d6f1-4656-b07f-8508dd50112b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:24 devstack sudo[97634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5b6d706a-d6f1-4656-b07f-8508dd50112b Nov 02 15:37:24 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:25 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2b213ff7-cf8a-4914-8a7c-5688c39309ac tempest-TestServerVolumeAttachmentScenario-743055380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5b6d706a-d6f1-4656-b07f-8508dd50112b" returned: 0 in 0.277s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:25 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-2b213ff7-cf8a-4914-8a7c-5688c39309ac tempest-TestServerVolumeAttachmentScenario-743055380 None] Lock "cinder-quobyte-5b6d706a-d6f1-4656-b07f-8508dd50112b" released by "delete_volume" :: held 0.770s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:37:25 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-2b213ff7-cf8a-4914-8a7c-5688c39309ac tempest-TestServerVolumeAttachmentScenario-743055380 None] Created reservations ['da876bd5-268d-413d-89b6-9eaddbb196e2', 'ecdd0332-7b33-44c2-b0f9-8d9e4ee04a05', '54408b80-4f0d-4bb5-a989-74ba1be762aa', '7040ea6c-52ea-4170-bf80-003ca26d7392'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:37:25 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1c704621-943d-4fbf-be36-291824b7c143 1073741824" returned: 0 in 0.508s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1c704621-943d-4fbf-be36-291824b7c143 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2b213ff7-cf8a-4914-8a7c-5688c39309ac tempest-TestServerVolumeAttachmentScenario-743055380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:37:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2b213ff7-cf8a-4914-8a7c-5688c39309ac tempest-TestServerVolumeAttachmentScenario-743055380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:37:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-2b213ff7-cf8a-4914-8a7c-5688c39309ac tempest-TestServerVolumeAttachmentScenario-743055380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:37:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-2b213ff7-cf8a-4914-8a7c-5688c39309ac tempest-TestServerVolumeAttachmentScenario-743055380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:37:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2b213ff7-cf8a-4914-8a7c-5688c39309ac tempest-TestServerVolumeAttachmentScenario-743055380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:37:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2b213ff7-cf8a-4914-8a7c-5688c39309ac tempest-TestServerVolumeAttachmentScenario-743055380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:25 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1c704621-943d-4fbf-be36-291824b7c143 Nov 02 15:37:25 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:25 devstack sudo[97644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:37:25 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:25 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-716c41cd-b3bd-43f7-99a6-f045e2d10071 tempest-TestServerVolumeAttachmentScenario-743055380 None] Acquiring lock "cinder-5ec9e9e3-1388-4519-aaa8-eca75332bfaf-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:37:25 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-716c41cd-b3bd-43f7-99a6-f045e2d10071 tempest-TestServerVolumeAttachmentScenario-743055380 None] Lock "cinder-5ec9e9e3-1388-4519-aaa8-eca75332bfaf-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:37:25 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2b213ff7-cf8a-4914-8a7c-5688c39309ac tempest-TestServerVolumeAttachmentScenario-743055380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.309s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:25 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-2b213ff7-cf8a-4914-8a7c-5688c39309ac tempest-TestServerVolumeAttachmentScenario-743055380 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:37:25 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-2b213ff7-cf8a-4914-8a7c-5688c39309ac tempest-TestServerVolumeAttachmentScenario-743055380 None] Deleted volume successfully. Nov 02 15:37:25 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1c704621-943d-4fbf-be36-291824b7c143" returned: 0 in 0.366s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:25 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-716c41cd-b3bd-43f7-99a6-f045e2d10071 tempest-TestServerVolumeAttachmentScenario-743055380 None] Acquiring lock "cinder-quobyte-5ec9e9e3-1388-4519-aaa8-eca75332bfaf" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:37:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:37:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:37:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1950d04f-39ee-4b71-ab16-3eb2bc92c478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c704621-943d-4fbf-be36-291824b7c143', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e78970-e87b-4c34-a707-b5a02caff918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:25 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-2b213ff7-cf8a-4914-8a7c-5688c39309ac tempest-TestServerVolumeAttachmentScenario-743055380 None] Lock "cinder-5b6d706a-d6f1-4656-b07f-8508dd50112b-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:37:25 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-716c41cd-b3bd-43f7-99a6-f045e2d10071 tempest-TestServerVolumeAttachmentScenario-743055380 None] Lock "cinder-quobyte-5ec9e9e3-1388-4519-aaa8-eca75332bfaf" acquired by "delete_volume" :: waited 0.045s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:37:25 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] Volume volume-1c704621-943d-4fbf-be36-291824b7c143 (1c704621-943d-4fbf-be36-291824b7c143): created successfully Nov 02 15:37:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3e78970-e87b-4c34-a707-b5a02caff918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] Flow 'volume_create_manager' (c3ea4e46-510a-4f21-abaa-2911c6309879) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:37:25 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58ccf90-7351-4b34-ae97-4725e76bab49]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:37:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-716c41cd-b3bd-43f7-99a6-f045e2d10071 tempest-TestServerVolumeAttachmentScenario-743055380 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5ec9e9e3-1388-4519-aaa8-eca75332bfaf {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:25 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-4423de31-0026-4868-8802-2aad174840b4 tempest-VolumesActionsTest-2019714403 None] Created volume successfully. Nov 02 15:37:25 devstack sudo[97650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5ec9e9e3-1388-4519-aaa8-eca75332bfaf Nov 02 15:37:25 devstack sudo[97650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:26 devstack sudo[97650]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-716c41cd-b3bd-43f7-99a6-f045e2d10071 tempest-TestServerVolumeAttachmentScenario-743055380 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5ec9e9e3-1388-4519-aaa8-eca75332bfaf" returned: 0 in 0.364s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-716c41cd-b3bd-43f7-99a6-f045e2d10071 tempest-TestServerVolumeAttachmentScenario-743055380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5ec9e9e3-1388-4519-aaa8-eca75332bfaf {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:26 devstack sudo[97655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5ec9e9e3-1388-4519-aaa8-eca75332bfaf Nov 02 15:37:26 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:26 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-716c41cd-b3bd-43f7-99a6-f045e2d10071 tempest-TestServerVolumeAttachmentScenario-743055380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5ec9e9e3-1388-4519-aaa8-eca75332bfaf" returned: 0 in 0.291s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:26 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-716c41cd-b3bd-43f7-99a6-f045e2d10071 tempest-TestServerVolumeAttachmentScenario-743055380 None] Lock "cinder-quobyte-5ec9e9e3-1388-4519-aaa8-eca75332bfaf" released by "delete_volume" :: held 0.709s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:37:26 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-716c41cd-b3bd-43f7-99a6-f045e2d10071 tempest-TestServerVolumeAttachmentScenario-743055380 None] Created reservations ['ec375f51-0530-4b4a-9cc1-507a26556eec', 'a5f1137c-802b-43c6-b0f1-f9fef361d7b9', 'e6a3341e-c1ae-43e2-b6a6-4f7062a98247', '102a695f-e5fc-4d6f-bc4c-a28f5661fd4b'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:37:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-716c41cd-b3bd-43f7-99a6-f045e2d10071 tempest-TestServerVolumeAttachmentScenario-743055380 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:37:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-716c41cd-b3bd-43f7-99a6-f045e2d10071 tempest-TestServerVolumeAttachmentScenario-743055380 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:37:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-716c41cd-b3bd-43f7-99a6-f045e2d10071 tempest-TestServerVolumeAttachmentScenario-743055380 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:37:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-716c41cd-b3bd-43f7-99a6-f045e2d10071 tempest-TestServerVolumeAttachmentScenario-743055380 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:37:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-716c41cd-b3bd-43f7-99a6-f045e2d10071 tempest-TestServerVolumeAttachmentScenario-743055380 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:37:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-716c41cd-b3bd-43f7-99a6-f045e2d10071 tempest-TestServerVolumeAttachmentScenario-743055380 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:26 devstack sudo[97658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:37:26 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:26 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-716c41cd-b3bd-43f7-99a6-f045e2d10071 tempest-TestServerVolumeAttachmentScenario-743055380 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.326s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:26 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-716c41cd-b3bd-43f7-99a6-f045e2d10071 tempest-TestServerVolumeAttachmentScenario-743055380 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:37:26 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-716c41cd-b3bd-43f7-99a6-f045e2d10071 tempest-TestServerVolumeAttachmentScenario-743055380 None] Deleted volume successfully. Nov 02 15:37:26 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-716c41cd-b3bd-43f7-99a6-f045e2d10071 tempest-TestServerVolumeAttachmentScenario-743055380 None] Lock "cinder-5ec9e9e3-1388-4519-aaa8-eca75332bfaf-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:37:26 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-9643708b-a872-452a-a71e-0fbf9c3f342c tempest-VolumesActionsTest-110662849 None] Acquiring lock "cinder-1c704621-943d-4fbf-be36-291824b7c143-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:37:26 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-9643708b-a872-452a-a71e-0fbf9c3f342c tempest-VolumesActionsTest-110662849 None] Lock "cinder-1c704621-943d-4fbf-be36-291824b7c143-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:37:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-9643708b-a872-452a-a71e-0fbf9c3f342c tempest-VolumesActionsTest-110662849 None] Acquiring lock "cinder-quobyte-1c704621-943d-4fbf-be36-291824b7c143" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:37:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-9643708b-a872-452a-a71e-0fbf9c3f342c tempest-VolumesActionsTest-110662849 None] Lock "cinder-quobyte-1c704621-943d-4fbf-be36-291824b7c143" acquired by "delete_volume" :: waited 0.031s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:37:27 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6ded39-e50b-4a61-a139-b5b83aa9fd19]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:37:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9643708b-a872-452a-a71e-0fbf9c3f342c tempest-VolumesActionsTest-110662849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1c704621-943d-4fbf-be36-291824b7c143 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:27 devstack sudo[97661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1c704621-943d-4fbf-be36-291824b7c143 Nov 02 15:37:27 devstack sudo[97661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:27 devstack sudo[97661]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9643708b-a872-452a-a71e-0fbf9c3f342c tempest-VolumesActionsTest-110662849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1c704621-943d-4fbf-be36-291824b7c143" returned: 0 in 0.420s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9643708b-a872-452a-a71e-0fbf9c3f342c tempest-VolumesActionsTest-110662849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1c704621-943d-4fbf-be36-291824b7c143 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:27 devstack sudo[97666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1c704621-943d-4fbf-be36-291824b7c143 Nov 02 15:37:27 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:27 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9643708b-a872-452a-a71e-0fbf9c3f342c tempest-VolumesActionsTest-110662849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1c704621-943d-4fbf-be36-291824b7c143" returned: 0 in 0.278s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-9643708b-a872-452a-a71e-0fbf9c3f342c tempest-VolumesActionsTest-110662849 None] Lock "cinder-quobyte-1c704621-943d-4fbf-be36-291824b7c143" released by "delete_volume" :: held 0.756s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:37:27 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-9643708b-a872-452a-a71e-0fbf9c3f342c tempest-VolumesActionsTest-110662849 None] Created reservations ['f5d4727f-7d9a-463f-a917-f410c9e709ae', 'dc91735e-79b3-44bc-ac7c-7740e9eab2b5', 'df9d7542-a173-42c3-ba23-86c43d292758', '740c3cd0-dc4d-4a40-922e-df1410aaf2c8'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:37:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9643708b-a872-452a-a71e-0fbf9c3f342c tempest-VolumesActionsTest-110662849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:37:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9643708b-a872-452a-a71e-0fbf9c3f342c tempest-VolumesActionsTest-110662849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:37:27 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9643708b-a872-452a-a71e-0fbf9c3f342c tempest-VolumesActionsTest-110662849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:37:27 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9643708b-a872-452a-a71e-0fbf9c3f342c tempest-VolumesActionsTest-110662849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:37:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9643708b-a872-452a-a71e-0fbf9c3f342c tempest-VolumesActionsTest-110662849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:37:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9643708b-a872-452a-a71e-0fbf9c3f342c tempest-VolumesActionsTest-110662849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:27 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:37:27 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:28 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9643708b-a872-452a-a71e-0fbf9c3f342c tempest-VolumesActionsTest-110662849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.279s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:28 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-9643708b-a872-452a-a71e-0fbf9c3f342c tempest-VolumesActionsTest-110662849 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:37:28 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-9643708b-a872-452a-a71e-0fbf9c3f342c tempest-VolumesActionsTest-110662849 None] Deleted volume successfully. Nov 02 15:37:28 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-9643708b-a872-452a-a71e-0fbf9c3f342c tempest-VolumesActionsTest-110662849 None] Lock "cinder-1c704621-943d-4fbf-be36-291824b7c143-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:37:28 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:37:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] Flow 'volume_create_manager' (17db6ce7-8bbc-4219-886b-89c671530ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:37:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d8ff910-5d55-4655-9d7a-f8be3612abe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d8ff910-5d55-4655-9d7a-f8be3612abe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-790494550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83bbda99-d5ea-4728-82fb-a16dc99f0f96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ce45fff2fb421381489b85e3fa993e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:37:29Z,use_quota=True,user_id='cc7281b883e94f48b6bf1de0bbbc52f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e700fdd-2d42-4cc9-aff1-4b09dda5ef1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e700fdd-2d42-4cc9-aff1-4b09dda5ef1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce02c0f-d039-4242-ad1f-261d98241cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ce02c0f-d039-4242-ad1f-261d98241cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83bbda99-d5ea-4728-82fb-a16dc99f0f96', 'volume_name': 'volume-83bbda99-d5ea-4728-82fb-a16dc99f0f96', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2505c9d-725d-47f5-9872-d6d4d7c5c734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2505c9d-725d-47f5-9872-d6d4d7c5c734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7824e969-b2d3-4d5f-8d8e-3feaaac4dc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:28 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] Volume 83bbda99-d5ea-4728-82fb-a16dc99f0f96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83bbda99-d5ea-4728-82fb-a16dc99f0f96', 'volume_size': 1} Nov 02 15:37:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:37:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:37:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-790494550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83bbda99-d5ea-4728-82fb-a16dc99f0f96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ce45fff2fb421381489b85e3fa993e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:37:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:37:29Z,use_quota=True,user_id='cc7281b883e94f48b6bf1de0bbbc52f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:37:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] Creating volume 83bbda99-d5ea-4728-82fb-a16dc99f0f96 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:37:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:37:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:37:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:37:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:37:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:37:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:37:28 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:37:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-83bbda99-d5ea-4728-82fb-a16dc99f0f96 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:28 devstack sudo[97673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-83bbda99-d5ea-4728-82fb-a16dc99f0f96 1073741824 Nov 02 15:37:28 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:29 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-83bbda99-d5ea-4728-82fb-a16dc99f0f96 1073741824" returned: 0 in 0.551s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-83bbda99-d5ea-4728-82fb-a16dc99f0f96 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:29 devstack sudo[97679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-83bbda99-d5ea-4728-82fb-a16dc99f0f96 Nov 02 15:37:29 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:29 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-83bbda99-d5ea-4728-82fb-a16dc99f0f96" returned: 0 in 0.290s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:37:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:37:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7824e969-b2d3-4d5f-8d8e-3feaaac4dc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83bbda99-d5ea-4728-82fb-a16dc99f0f96', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5155f3d2-e8f8-43ca-8b58-a000a101503b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:29 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] Volume volume-83bbda99-d5ea-4728-82fb-a16dc99f0f96 (83bbda99-d5ea-4728-82fb-a16dc99f0f96): created successfully Nov 02 15:37:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5155f3d2-e8f8-43ca-8b58-a000a101503b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] Flow 'volume_create_manager' (17db6ce7-8bbc-4219-886b-89c671530ded) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:37:29 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-9c519024-3d92-4af8-a648-fc227ebeeb46 tempest-VolumesActionsTest-2019714403 None] Created volume successfully. Nov 02 15:37:30 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-2c077712-a342-4810-9846-f33883da51a0 tempest-VolumesActionsTest-110662849 None] Acquiring lock "cinder-83bbda99-d5ea-4728-82fb-a16dc99f0f96-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:37:30 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-2c077712-a342-4810-9846-f33883da51a0 tempest-VolumesActionsTest-110662849 None] Lock "cinder-83bbda99-d5ea-4728-82fb-a16dc99f0f96-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:37:31 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-2c077712-a342-4810-9846-f33883da51a0 tempest-VolumesActionsTest-110662849 None] Acquiring lock "cinder-quobyte-83bbda99-d5ea-4728-82fb-a16dc99f0f96" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:37:31 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-2c077712-a342-4810-9846-f33883da51a0 tempest-VolumesActionsTest-110662849 None] Lock "cinder-quobyte-83bbda99-d5ea-4728-82fb-a16dc99f0f96" acquired by "delete_volume" :: waited 0.018s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:37:31 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[93068d5f-5dda-4ca9-b71c-fde2dd17018b]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:37:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2c077712-a342-4810-9846-f33883da51a0 tempest-VolumesActionsTest-110662849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-83bbda99-d5ea-4728-82fb-a16dc99f0f96 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:31 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-83bbda99-d5ea-4728-82fb-a16dc99f0f96 Nov 02 15:37:31 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:31 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2c077712-a342-4810-9846-f33883da51a0 tempest-VolumesActionsTest-110662849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-83bbda99-d5ea-4728-82fb-a16dc99f0f96" returned: 0 in 0.426s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2c077712-a342-4810-9846-f33883da51a0 tempest-VolumesActionsTest-110662849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-83bbda99-d5ea-4728-82fb-a16dc99f0f96 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:31 devstack sudo[97689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-83bbda99-d5ea-4728-82fb-a16dc99f0f96 Nov 02 15:37:31 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:31 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2c077712-a342-4810-9846-f33883da51a0 tempest-VolumesActionsTest-110662849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-83bbda99-d5ea-4728-82fb-a16dc99f0f96" returned: 0 in 0.289s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:31 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-2c077712-a342-4810-9846-f33883da51a0 tempest-VolumesActionsTest-110662849 None] Lock "cinder-quobyte-83bbda99-d5ea-4728-82fb-a16dc99f0f96" released by "delete_volume" :: held 0.780s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:37:31 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-2c077712-a342-4810-9846-f33883da51a0 tempest-VolumesActionsTest-110662849 None] Created reservations ['4070f526-e6b2-46f7-937d-5a80c0aea130', '8755836a-b2a6-473d-85c2-779ac5a63d66', 'fec2a6a0-7fd9-464d-86ee-adea4e598f89', '07be8ff2-4773-4dce-bee5-12740097a25b'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:37:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2c077712-a342-4810-9846-f33883da51a0 tempest-VolumesActionsTest-110662849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:37:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2c077712-a342-4810-9846-f33883da51a0 tempest-VolumesActionsTest-110662849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:37:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-2c077712-a342-4810-9846-f33883da51a0 tempest-VolumesActionsTest-110662849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:37:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-2c077712-a342-4810-9846-f33883da51a0 tempest-VolumesActionsTest-110662849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:37:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2c077712-a342-4810-9846-f33883da51a0 tempest-VolumesActionsTest-110662849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:37:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2c077712-a342-4810-9846-f33883da51a0 tempest-VolumesActionsTest-110662849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:32 devstack sudo[97694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:37:32 devstack sudo[97694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:32 devstack sudo[97694]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2c077712-a342-4810-9846-f33883da51a0 tempest-VolumesActionsTest-110662849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.454s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:32 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-2c077712-a342-4810-9846-f33883da51a0 tempest-VolumesActionsTest-110662849 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:37:32 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-2c077712-a342-4810-9846-f33883da51a0 tempest-VolumesActionsTest-110662849 None] Deleted volume successfully. Nov 02 15:37:32 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-2c077712-a342-4810-9846-f33883da51a0 tempest-VolumesActionsTest-110662849 None] Lock "cinder-83bbda99-d5ea-4728-82fb-a16dc99f0f96-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:37:33 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:37:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] Flow 'volume_create_manager' (1b798a8a-d8e7-4533-9abd-336eeb967b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:37:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4d24916-1cbf-4fc2-94cc-35620b1327cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4d24916-1cbf-4fc2-94cc-35620b1327cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-48009029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5777ae6-3359-409f-846d-5bc4825397b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ce45fff2fb421381489b85e3fa993e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:37:33Z,use_quota=True,user_id='cc7281b883e94f48b6bf1de0bbbc52f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4123d45-715b-40fb-aadc-02871a856275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4123d45-715b-40fb-aadc-02871a856275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1696d287-f610-4713-af98-73f2c78128d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1696d287-f610-4713-af98-73f2c78128d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5777ae6-3359-409f-846d-5bc4825397b8', 'volume_name': 'volume-f5777ae6-3359-409f-846d-5bc4825397b8', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40d564b-886c-4e9c-8920-86870a0ccfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c40d564b-886c-4e9c-8920-86870a0ccfe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4598b8-d9d4-43fc-8cd6-9513f0f5a198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:33 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] Volume f5777ae6-3359-409f-846d-5bc4825397b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5777ae6-3359-409f-846d-5bc4825397b8', 'volume_size': 1} Nov 02 15:37:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:37:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:37:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-48009029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5777ae6-3359-409f-846d-5bc4825397b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ce45fff2fb421381489b85e3fa993e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:37:33Z,use_quota=True,user_id='cc7281b883e94f48b6bf1de0bbbc52f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:37:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] Creating volume f5777ae6-3359-409f-846d-5bc4825397b8 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:37:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:37:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:37:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:37:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:37:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:37:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:37:33 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:37:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f5777ae6-3359-409f-846d-5bc4825397b8 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:33 devstack sudo[97718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f5777ae6-3359-409f-846d-5bc4825397b8 1073741824 Nov 02 15:37:33 devstack sudo[97718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:33 devstack sudo[97718]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f5777ae6-3359-409f-846d-5bc4825397b8 1073741824" returned: 0 in 0.544s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f5777ae6-3359-409f-846d-5bc4825397b8 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:33 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f5777ae6-3359-409f-846d-5bc4825397b8 Nov 02 15:37:33 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:34 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f5777ae6-3359-409f-846d-5bc4825397b8" returned: 0 in 0.319s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:34 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:37:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:37:34 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4598b8-d9d4-43fc-8cd6-9513f0f5a198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5777ae6-3359-409f-846d-5bc4825397b8', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:34 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a41673a8-f422-49ff-b232-75404edda132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:34 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] Volume volume-f5777ae6-3359-409f-846d-5bc4825397b8 (f5777ae6-3359-409f-846d-5bc4825397b8): created successfully Nov 02 15:37:34 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a41673a8-f422-49ff-b232-75404edda132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:34 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] Flow 'volume_create_manager' (1b798a8a-d8e7-4533-9abd-336eeb967b37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:37:34 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-530fa1ff-c53b-4d84-8a28-7d81d9e2da7b tempest-VolumesActionsTest-2019714403 None] Created volume successfully. Nov 02 15:37:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f7c2a159-3598-43c9-825a-6256e812f7ec tempest-VolumesActionsTest-110662849 None] Acquiring lock "cinder-f5777ae6-3359-409f-846d-5bc4825397b8-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:37:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f7c2a159-3598-43c9-825a-6256e812f7ec tempest-VolumesActionsTest-110662849 None] Lock "cinder-f5777ae6-3359-409f-846d-5bc4825397b8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:37:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f7c2a159-3598-43c9-825a-6256e812f7ec tempest-VolumesActionsTest-110662849 None] Acquiring lock "cinder-quobyte-f5777ae6-3359-409f-846d-5bc4825397b8" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:37:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f7c2a159-3598-43c9-825a-6256e812f7ec tempest-VolumesActionsTest-110662849 None] Lock "cinder-quobyte-f5777ae6-3359-409f-846d-5bc4825397b8" acquired by "delete_volume" :: waited 0.018s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:37:35 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[642c2e50-07bd-4f6b-b812-173b1608d853]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:37:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f7c2a159-3598-43c9-825a-6256e812f7ec tempest-VolumesActionsTest-110662849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f5777ae6-3359-409f-846d-5bc4825397b8 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:35 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f5777ae6-3359-409f-846d-5bc4825397b8 Nov 02 15:37:35 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:35 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f7c2a159-3598-43c9-825a-6256e812f7ec tempest-VolumesActionsTest-110662849 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f5777ae6-3359-409f-846d-5bc4825397b8" returned: 0 in 0.500s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f7c2a159-3598-43c9-825a-6256e812f7ec tempest-VolumesActionsTest-110662849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f5777ae6-3359-409f-846d-5bc4825397b8 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:35 devstack sudo[97737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f5777ae6-3359-409f-846d-5bc4825397b8 Nov 02 15:37:35 devstack sudo[97737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:36 devstack sudo[97737]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f7c2a159-3598-43c9-825a-6256e812f7ec tempest-VolumesActionsTest-110662849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f5777ae6-3359-409f-846d-5bc4825397b8" returned: 0 in 0.276s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f7c2a159-3598-43c9-825a-6256e812f7ec tempest-VolumesActionsTest-110662849 None] Lock "cinder-quobyte-f5777ae6-3359-409f-846d-5bc4825397b8" released by "delete_volume" :: held 0.839s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:37:36 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-f7c2a159-3598-43c9-825a-6256e812f7ec tempest-VolumesActionsTest-110662849 None] Created reservations ['1537f841-532d-4c5d-922b-5b09f51a8cfc', '6c068775-a4bc-48a4-b5e1-f0d55881029d', 'c588f8b7-415c-4c97-9881-6821924b5642', '34ec0664-2ecd-4059-8462-2b4e9b0280c5'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:37:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f7c2a159-3598-43c9-825a-6256e812f7ec tempest-VolumesActionsTest-110662849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:37:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f7c2a159-3598-43c9-825a-6256e812f7ec tempest-VolumesActionsTest-110662849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:37:36 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f7c2a159-3598-43c9-825a-6256e812f7ec tempest-VolumesActionsTest-110662849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:37:36 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f7c2a159-3598-43c9-825a-6256e812f7ec tempest-VolumesActionsTest-110662849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:37:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f7c2a159-3598-43c9-825a-6256e812f7ec tempest-VolumesActionsTest-110662849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:37:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f7c2a159-3598-43c9-825a-6256e812f7ec tempest-VolumesActionsTest-110662849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:36 devstack sudo[97740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:37:36 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:36 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f7c2a159-3598-43c9-825a-6256e812f7ec tempest-VolumesActionsTest-110662849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.440s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:36 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-f7c2a159-3598-43c9-825a-6256e812f7ec tempest-VolumesActionsTest-110662849 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:37:36 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-f7c2a159-3598-43c9-825a-6256e812f7ec tempest-VolumesActionsTest-110662849 None] Deleted volume successfully. Nov 02 15:37:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f7c2a159-3598-43c9-825a-6256e812f7ec tempest-VolumesActionsTest-110662849 None] Lock "cinder-f5777ae6-3359-409f-846d-5bc4825397b8-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:37:37 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:37:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] Flow 'volume_create_manager' (344f9d48-7189-492c-b5ef-759f1cc33b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:37:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (820111b5-79cb-4ab6-9aea-39858d106b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (820111b5-79cb-4ab6-9aea-39858d106b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-608938251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c73b805-0a5c-4af0-a358-f583988f2f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ce45fff2fb421381489b85e3fa993e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:37:37Z,use_quota=True,user_id='cc7281b883e94f48b6bf1de0bbbc52f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8ba0d15-1420-44a9-8f9f-51db5c0ee314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8ba0d15-1420-44a9-8f9f-51db5c0ee314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db978902-f287-4111-99ad-3e16ec073b5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db978902-f287-4111-99ad-3e16ec073b5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c73b805-0a5c-4af0-a358-f583988f2f05', 'volume_name': 'volume-4c73b805-0a5c-4af0-a358-f583988f2f05', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866819ff-46a8-492d-a4ae-5ffc24e40854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (866819ff-46a8-492d-a4ae-5ffc24e40854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec330648-2536-465a-bec1-6662c4186f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:37 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] Volume 4c73b805-0a5c-4af0-a358-f583988f2f05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c73b805-0a5c-4af0-a358-f583988f2f05', 'volume_size': 1} Nov 02 15:37:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:37:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:37:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-608938251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c73b805-0a5c-4af0-a358-f583988f2f05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ce45fff2fb421381489b85e3fa993e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:37:37Z,use_quota=True,user_id='cc7281b883e94f48b6bf1de0bbbc52f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:37:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] Creating volume 4c73b805-0a5c-4af0-a358-f583988f2f05 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:37:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:37:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:37:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:37:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:37:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:37:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:37:37 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:37:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4c73b805-0a5c-4af0-a358-f583988f2f05 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:37 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-02752a31-a7bc-4ce0-9b37-5ec0e41468d8 tempest-AttachVolumeShelveTestJSON-45132328 None] Acquiring lock "cinder-745368ef-a593-49fc-bcf9-01fafdb258bc-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:37:37 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4c73b805-0a5c-4af0-a358-f583988f2f05 1073741824 Nov 02 15:37:37 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:37 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-02752a31-a7bc-4ce0-9b37-5ec0e41468d8 tempest-AttachVolumeShelveTestJSON-45132328 None] Lock "cinder-745368ef-a593-49fc-bcf9-01fafdb258bc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:37:37 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-02752a31-a7bc-4ce0-9b37-5ec0e41468d8 tempest-AttachVolumeShelveTestJSON-45132328 None] Acquiring lock "cinder-quobyte-745368ef-a593-49fc-bcf9-01fafdb258bc" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:37:37 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-02752a31-a7bc-4ce0-9b37-5ec0e41468d8 tempest-AttachVolumeShelveTestJSON-45132328 None] Lock "cinder-quobyte-745368ef-a593-49fc-bcf9-01fafdb258bc" acquired by "delete_volume" :: waited 0.020s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:37:37 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b852159-79d2-44b7-9a22-8f0b475a1654]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:37:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-02752a31-a7bc-4ce0-9b37-5ec0e41468d8 tempest-AttachVolumeShelveTestJSON-45132328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-745368ef-a593-49fc-bcf9-01fafdb258bc {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:37 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-745368ef-a593-49fc-bcf9-01fafdb258bc Nov 02 15:37:37 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:38 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4c73b805-0a5c-4af0-a358-f583988f2f05 1073741824" returned: 0 in 0.537s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4c73b805-0a5c-4af0-a358-f583988f2f05 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:38 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4c73b805-0a5c-4af0-a358-f583988f2f05 Nov 02 15:37:38 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:38 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-02752a31-a7bc-4ce0-9b37-5ec0e41468d8 tempest-AttachVolumeShelveTestJSON-45132328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-745368ef-a593-49fc-bcf9-01fafdb258bc" returned: 0 in 0.474s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-02752a31-a7bc-4ce0-9b37-5ec0e41468d8 tempest-AttachVolumeShelveTestJSON-45132328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-745368ef-a593-49fc-bcf9-01fafdb258bc {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:38 devstack sudo[97757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-745368ef-a593-49fc-bcf9-01fafdb258bc Nov 02 15:37:38 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:38 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4c73b805-0a5c-4af0-a358-f583988f2f05" returned: 0 in 0.309s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:37:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:37:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec330648-2536-465a-bec1-6662c4186f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c73b805-0a5c-4af0-a358-f583988f2f05', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a40ff9-a2e3-4067-a90f-052086afc7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:38 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-02752a31-a7bc-4ce0-9b37-5ec0e41468d8 tempest-AttachVolumeShelveTestJSON-45132328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-745368ef-a593-49fc-bcf9-01fafdb258bc" returned: 0 in 0.302s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:38 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] Volume volume-4c73b805-0a5c-4af0-a358-f583988f2f05 (4c73b805-0a5c-4af0-a358-f583988f2f05): created successfully Nov 02 15:37:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0a40ff9-a2e3-4067-a90f-052086afc7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] Flow 'volume_create_manager' (344f9d48-7189-492c-b5ef-759f1cc33b80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:37:38 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-02752a31-a7bc-4ce0-9b37-5ec0e41468d8 tempest-AttachVolumeShelveTestJSON-45132328 None] Lock "cinder-quobyte-745368ef-a593-49fc-bcf9-01fafdb258bc" released by "delete_volume" :: held 0.845s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:37:38 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-16016978-7cc5-46df-8a01-97f1c6da19b8 tempest-VolumesActionsTest-2019714403 None] Created volume successfully. Nov 02 15:37:38 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-02752a31-a7bc-4ce0-9b37-5ec0e41468d8 tempest-AttachVolumeShelveTestJSON-45132328 None] Created reservations ['f771b8ac-66b5-43bd-96fa-f367e8b17dc3', '20fa3fb7-0cfd-4ea1-97b3-2b2976377b39', '2e842b46-2743-4b47-ad41-ff350a4dd387', '441e08bb-22e7-4654-9ad7-af3e88db6ee2'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:37:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-02752a31-a7bc-4ce0-9b37-5ec0e41468d8 tempest-AttachVolumeShelveTestJSON-45132328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:37:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-02752a31-a7bc-4ce0-9b37-5ec0e41468d8 tempest-AttachVolumeShelveTestJSON-45132328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:37:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-02752a31-a7bc-4ce0-9b37-5ec0e41468d8 tempest-AttachVolumeShelveTestJSON-45132328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:37:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-02752a31-a7bc-4ce0-9b37-5ec0e41468d8 tempest-AttachVolumeShelveTestJSON-45132328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:37:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-02752a31-a7bc-4ce0-9b37-5ec0e41468d8 tempest-AttachVolumeShelveTestJSON-45132328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:37:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-02752a31-a7bc-4ce0-9b37-5ec0e41468d8 tempest-AttachVolumeShelveTestJSON-45132328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:38 devstack sudo[97761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:37:38 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:38 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-02752a31-a7bc-4ce0-9b37-5ec0e41468d8 tempest-AttachVolumeShelveTestJSON-45132328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.278s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:38 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-02752a31-a7bc-4ce0-9b37-5ec0e41468d8 tempest-AttachVolumeShelveTestJSON-45132328 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:37:38 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-02752a31-a7bc-4ce0-9b37-5ec0e41468d8 tempest-AttachVolumeShelveTestJSON-45132328 None] Deleted volume successfully. Nov 02 15:37:38 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-02752a31-a7bc-4ce0-9b37-5ec0e41468d8 tempest-AttachVolumeShelveTestJSON-45132328 None] Lock "cinder-745368ef-a593-49fc-bcf9-01fafdb258bc-delete_volume" released by "delete_volume" :: held 1.389s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:37:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-18331169-a2ee-4eb0-b57f-9f361ddd83ad tempest-VolumesActionsTest-2019714403 None] Acquiring lock "cinder-4c73b805-0a5c-4af0-a358-f583988f2f05-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:37:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-18331169-a2ee-4eb0-b57f-9f361ddd83ad tempest-VolumesActionsTest-2019714403 None] Lock "cinder-4c73b805-0a5c-4af0-a358-f583988f2f05-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:37:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-18331169-a2ee-4eb0-b57f-9f361ddd83ad tempest-VolumesActionsTest-2019714403 None] Acquiring lock "cinder-quobyte-4c73b805-0a5c-4af0-a358-f583988f2f05" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:37:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-18331169-a2ee-4eb0-b57f-9f361ddd83ad tempest-VolumesActionsTest-2019714403 None] Lock "cinder-quobyte-4c73b805-0a5c-4af0-a358-f583988f2f05" acquired by "delete_volume" :: waited 0.023s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:37:40 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fdf015-631f-4bf6-bf90-0c4b06a5d173]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:37:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-18331169-a2ee-4eb0-b57f-9f361ddd83ad tempest-VolumesActionsTest-2019714403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4c73b805-0a5c-4af0-a358-f583988f2f05 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:40 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4c73b805-0a5c-4af0-a358-f583988f2f05 Nov 02 15:37:40 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:40 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-18331169-a2ee-4eb0-b57f-9f361ddd83ad tempest-VolumesActionsTest-2019714403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4c73b805-0a5c-4af0-a358-f583988f2f05" returned: 0 in 0.484s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-18331169-a2ee-4eb0-b57f-9f361ddd83ad tempest-VolumesActionsTest-2019714403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4c73b805-0a5c-4af0-a358-f583988f2f05 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:40 devstack sudo[97773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4c73b805-0a5c-4af0-a358-f583988f2f05 Nov 02 15:37:40 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:41 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-18331169-a2ee-4eb0-b57f-9f361ddd83ad tempest-VolumesActionsTest-2019714403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4c73b805-0a5c-4af0-a358-f583988f2f05" returned: 0 in 0.345s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-18331169-a2ee-4eb0-b57f-9f361ddd83ad tempest-VolumesActionsTest-2019714403 None] Lock "cinder-quobyte-4c73b805-0a5c-4af0-a358-f583988f2f05" released by "delete_volume" :: held 0.904s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-18331169-a2ee-4eb0-b57f-9f361ddd83ad tempest-VolumesActionsTest-2019714403 None] Created reservations ['19c3fc2d-5281-421b-a134-8c35a479c536', '7b51f68f-1f9f-43cd-8a39-eec12cd62f18', '3888fc0a-64d0-49bb-b9fb-79c5edfa17a1', '497ed4f9-fc56-4c3c-82ae-cd2d50b34416'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] Flow 'volume_create_manager' (662eb77f-8f97-4ad2-833c-8e9ab1f35e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0333fc1-2cb5-49e4-b5bb-c731e5e92657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0333fc1-2cb5-49e4-b5bb-c731e5e92657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1786714687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e52404d-f293-4b32-9f05-5784f67cb3ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a129d023d74ae690f617c854ba4c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:37:41Z,use_quota=True,user_id='d9797744c3544776ada81755252e15b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cba1d197-9e47-4c6e-8985-d95438ebaadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cba1d197-9e47-4c6e-8985-d95438ebaadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a45358b-bd42-4d29-a5cd-df3a03187167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a45358b-bd42-4d29-a5cd-df3a03187167) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e52404d-f293-4b32-9f05-5784f67cb3ec', 'volume_name': 'volume-7e52404d-f293-4b32-9f05-5784f67cb3ec', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (617116c9-413e-4c33-bf08-d685384dd0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (617116c9-413e-4c33-bf08-d685384dd0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab35d0e-1ffa-431a-9d4f-bb8a9dc183f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:41 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] Volume 7e52404d-f293-4b32-9f05-5784f67cb3ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e52404d-f293-4b32-9f05-5784f67cb3ec', 'volume_size': 1} Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1786714687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e52404d-f293-4b32-9f05-5784f67cb3ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29a129d023d74ae690f617c854ba4c09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:37:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:37:41Z,use_quota=True,user_id='d9797744c3544776ada81755252e15b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] Creating volume 7e52404d-f293-4b32-9f05-5784f67cb3ec {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:37:41 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7e52404d-f293-4b32-9f05-5784f67cb3ec 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:41 devstack sudo[97776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7e52404d-f293-4b32-9f05-5784f67cb3ec 1073741824 Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-18331169-a2ee-4eb0-b57f-9f361ddd83ad tempest-VolumesActionsTest-2019714403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-18331169-a2ee-4eb0-b57f-9f361ddd83ad tempest-VolumesActionsTest-2019714403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-18331169-a2ee-4eb0-b57f-9f361ddd83ad tempest-VolumesActionsTest-2019714403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:37:41 devstack sudo[97776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-18331169-a2ee-4eb0-b57f-9f361ddd83ad tempest-VolumesActionsTest-2019714403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-18331169-a2ee-4eb0-b57f-9f361ddd83ad tempest-VolumesActionsTest-2019714403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-18331169-a2ee-4eb0-b57f-9f361ddd83ad tempest-VolumesActionsTest-2019714403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:41 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:37:41 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:41 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-18331169-a2ee-4eb0-b57f-9f361ddd83ad tempest-VolumesActionsTest-2019714403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.357s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-18331169-a2ee-4eb0-b57f-9f361ddd83ad tempest-VolumesActionsTest-2019714403 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:37:41 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-18331169-a2ee-4eb0-b57f-9f361ddd83ad tempest-VolumesActionsTest-2019714403 None] Deleted volume successfully. Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-18331169-a2ee-4eb0-b57f-9f361ddd83ad tempest-VolumesActionsTest-2019714403 None] Lock "cinder-4c73b805-0a5c-4af0-a358-f583988f2f05-delete_volume" released by "delete_volume" :: held 1.721s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:37:41 devstack sudo[97776]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7e52404d-f293-4b32-9f05-5784f67cb3ec 1073741824" returned: 0 in 0.566s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7e52404d-f293-4b32-9f05-5784f67cb3ec {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:37:41 devstack sudo[97785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7e52404d-f293-4b32-9f05-5784f67cb3ec Nov 02 15:37:41 devstack sudo[97785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:37:42 devstack sudo[97785]: pam_unix(sudo:session): session closed for user root Nov 02 15:37:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7e52404d-f293-4b32-9f05-5784f67cb3ec" returned: 0 in 0.251s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:37:42 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:37:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:37:42 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ab35d0e-1ffa-431a-9d4f-bb8a9dc183f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e52404d-f293-4b32-9f05-5784f67cb3ec', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:42 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9637b876-a4ed-4fd9-a2e3-c4ee6e351675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:37:42 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] Volume volume-7e52404d-f293-4b32-9f05-5784f67cb3ec (7e52404d-f293-4b32-9f05-5784f67cb3ec): created successfully Nov 02 15:37:42 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9637b876-a4ed-4fd9-a2e3-c4ee6e351675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:37:42 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] Flow 'volume_create_manager' (662eb77f-8f97-4ad2-833c-8e9ab1f35e50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:37:42 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-b4fc6544-0147-4c9d-91d9-cebe348390dc tempest-AttachVolumeNegativeTest-1941915072 None] Created volume successfully. Nov 02 15:37:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-926d9576-61bf-4af3-b38c-1f5152336a01 req-d4d5a8da-37c0-427a-b529-e5be7228e84a tempest-AttachVolumeNegativeTest-1941915072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:37:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-926d9576-61bf-4af3-b38c-1f5152336a01 req-d4d5a8da-37c0-427a-b529-e5be7228e84a tempest-AttachVolumeNegativeTest-1941915072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:37:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-926d9576-61bf-4af3-b38c-1f5152336a01 req-d4d5a8da-37c0-427a-b529-e5be7228e84a tempest-AttachVolumeNegativeTest-1941915072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:37:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-926d9576-61bf-4af3-b38c-1f5152336a01 req-d4d5a8da-37c0-427a-b529-e5be7228e84a tempest-AttachVolumeNegativeTest-1941915072 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478', 'name': 'volume-7e52404d-f293-4b32-9f05-5784f67cb3ec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3cb42ee6-3725-41c4-a2ca-dbae4fbafea0', 'enforce_multipath': True} {{(pid=86703) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 15:37:44 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-926d9576-61bf-4af3-b38c-1f5152336a01 req-d4d5a8da-37c0-427a-b529-e5be7228e84a tempest-AttachVolumeNegativeTest-1941915072 None] attachment_update completed successfully. Nov 02 15:37:47 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-b01c4d40-20a1-4e75-8729-8209f459f15c req-d38c67c4-af99-40cf-becf-a9b99e006f05 tempest-AttachVolumeNegativeTest-1941915072 None] Terminate volume connection completed successfully. Nov 02 15:37:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-b01c4d40-20a1-4e75-8729-8209f459f15c req-d38c67c4-af99-40cf-becf-a9b99e006f05 tempest-AttachVolumeNegativeTest-1941915072 None] Deleting attachment 3cb42ee6-3725-41c4-a2ca-dbae4fbafea0. {{(pid=86703) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 15:37:53 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1a3be46e-48d3-4b83-b820-481fdaaa0934 tempest-BackendsCapabilitiesAdminTestsJSON-1859845661 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8291549682617, 'free_capacity_gb': 1773.8291549682617, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86703) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 15:37:53 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-40e0fd64-eb15-4ffa-a757-80c408b11da2 tempest-BackendsCapabilitiesAdminTestsJSON-1859845661 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8291549682617, 'free_capacity_gb': 1773.8291549682617, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86703) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 15:37:57 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=94,cinder:UPDATE=97,cinder:INSERT=23,cinder:DELETE=8 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:37:57 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=84,cinder:UPDATE=105,cinder:INSERT=22,cinder:DELETE=8 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:37:59 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-02c713c7-423a-46f0-9d62-0b7a56d88a3b tempest-AttachVolumeNegativeTest-1941915072 None] Acquiring lock "cinder-7e52404d-f293-4b32-9f05-5784f67cb3ec-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:37:59 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-02c713c7-423a-46f0-9d62-0b7a56d88a3b tempest-AttachVolumeNegativeTest-1941915072 None] Lock "cinder-7e52404d-f293-4b32-9f05-5784f67cb3ec-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:37:59 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-02c713c7-423a-46f0-9d62-0b7a56d88a3b tempest-AttachVolumeNegativeTest-1941915072 None] Acquiring lock "cinder-quobyte-7e52404d-f293-4b32-9f05-5784f67cb3ec" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:37:59 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-02c713c7-423a-46f0-9d62-0b7a56d88a3b tempest-AttachVolumeNegativeTest-1941915072 None] Lock "cinder-quobyte-7e52404d-f293-4b32-9f05-5784f67cb3ec" acquired by "delete_volume" :: waited 0.020s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:37:59 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[53092b9e-af1c-4603-b415-8b5983b45edf]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:37:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-02c713c7-423a-46f0-9d62-0b7a56d88a3b tempest-AttachVolumeNegativeTest-1941915072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7e52404d-f293-4b32-9f05-5784f67cb3ec {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:00 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7e52404d-f293-4b32-9f05-5784f67cb3ec Nov 02 15:38:00 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:00 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-02c713c7-423a-46f0-9d62-0b7a56d88a3b tempest-AttachVolumeNegativeTest-1941915072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7e52404d-f293-4b32-9f05-5784f67cb3ec" returned: 0 in 0.437s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-02c713c7-423a-46f0-9d62-0b7a56d88a3b tempest-AttachVolumeNegativeTest-1941915072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7e52404d-f293-4b32-9f05-5784f67cb3ec {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:00 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7e52404d-f293-4b32-9f05-5784f67cb3ec Nov 02 15:38:00 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:00 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-02c713c7-423a-46f0-9d62-0b7a56d88a3b tempest-AttachVolumeNegativeTest-1941915072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7e52404d-f293-4b32-9f05-5784f67cb3ec" returned: 0 in 0.317s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:00 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-02c713c7-423a-46f0-9d62-0b7a56d88a3b tempest-AttachVolumeNegativeTest-1941915072 None] Lock "cinder-quobyte-7e52404d-f293-4b32-9f05-5784f67cb3ec" released by "delete_volume" :: held 0.825s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:38:00 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-02c713c7-423a-46f0-9d62-0b7a56d88a3b tempest-AttachVolumeNegativeTest-1941915072 None] Created reservations ['da37ea34-e15a-41d7-970c-432fd5908b51', '0f0f5e7f-531b-4917-bb49-feb2ead7d3c2', 'ca342ab2-9d24-4421-98be-3467f164ab3a', '96d6506d-6877-4e62-ab33-10bf631c30ae'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:38:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-02c713c7-423a-46f0-9d62-0b7a56d88a3b tempest-AttachVolumeNegativeTest-1941915072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-02c713c7-423a-46f0-9d62-0b7a56d88a3b tempest-AttachVolumeNegativeTest-1941915072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:00 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-02c713c7-423a-46f0-9d62-0b7a56d88a3b tempest-AttachVolumeNegativeTest-1941915072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:38:00 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-02c713c7-423a-46f0-9d62-0b7a56d88a3b tempest-AttachVolumeNegativeTest-1941915072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:38:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-02c713c7-423a-46f0-9d62-0b7a56d88a3b tempest-AttachVolumeNegativeTest-1941915072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-02c713c7-423a-46f0-9d62-0b7a56d88a3b tempest-AttachVolumeNegativeTest-1941915072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:00 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:38:00 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:01 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5ecdf25d-dcb0-4ba8-beb5-59ad784476be tempest-AttachVolumeNegativeTest-1941915072 None] Acquiring lock "cinder-68552a60-ad42-46f5-a4bd-bd20650d5d83-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:38:01 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5ecdf25d-dcb0-4ba8-beb5-59ad784476be tempest-AttachVolumeNegativeTest-1941915072 None] Lock "cinder-68552a60-ad42-46f5-a4bd-bd20650d5d83-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:38:01 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5ecdf25d-dcb0-4ba8-beb5-59ad784476be tempest-AttachVolumeNegativeTest-1941915072 None] Acquiring lock "cinder-quobyte-68552a60-ad42-46f5-a4bd-bd20650d5d83" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:38:01 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5ecdf25d-dcb0-4ba8-beb5-59ad784476be tempest-AttachVolumeNegativeTest-1941915072 None] Lock "cinder-quobyte-68552a60-ad42-46f5-a4bd-bd20650d5d83" acquired by "delete_volume" :: waited 0.026s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:38:01 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[697d9640-e943-43cd-bbc9-68832da66fae]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:38:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5ecdf25d-dcb0-4ba8-beb5-59ad784476be tempest-AttachVolumeNegativeTest-1941915072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68552a60-ad42-46f5-a4bd-bd20650d5d83 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:01 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-02c713c7-423a-46f0-9d62-0b7a56d88a3b tempest-AttachVolumeNegativeTest-1941915072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.445s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:01 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-02c713c7-423a-46f0-9d62-0b7a56d88a3b tempest-AttachVolumeNegativeTest-1941915072 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:38:01 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-02c713c7-423a-46f0-9d62-0b7a56d88a3b tempest-AttachVolumeNegativeTest-1941915072 None] Deleted volume successfully. Nov 02 15:38:01 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-02c713c7-423a-46f0-9d62-0b7a56d88a3b tempest-AttachVolumeNegativeTest-1941915072 None] Lock "cinder-7e52404d-f293-4b32-9f05-5784f67cb3ec-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:38:01 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68552a60-ad42-46f5-a4bd-bd20650d5d83 Nov 02 15:38:01 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:01 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5ecdf25d-dcb0-4ba8-beb5-59ad784476be tempest-AttachVolumeNegativeTest-1941915072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68552a60-ad42-46f5-a4bd-bd20650d5d83" returned: 0 in 0.459s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5ecdf25d-dcb0-4ba8-beb5-59ad784476be tempest-AttachVolumeNegativeTest-1941915072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68552a60-ad42-46f5-a4bd-bd20650d5d83 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:01 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68552a60-ad42-46f5-a4bd-bd20650d5d83 Nov 02 15:38:01 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:02 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5ecdf25d-dcb0-4ba8-beb5-59ad784476be tempest-AttachVolumeNegativeTest-1941915072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-68552a60-ad42-46f5-a4bd-bd20650d5d83" returned: 0 in 0.277s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:02 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5ecdf25d-dcb0-4ba8-beb5-59ad784476be tempest-AttachVolumeNegativeTest-1941915072 None] Lock "cinder-quobyte-68552a60-ad42-46f5-a4bd-bd20650d5d83" released by "delete_volume" :: held 0.794s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:38:02 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-5ecdf25d-dcb0-4ba8-beb5-59ad784476be tempest-AttachVolumeNegativeTest-1941915072 None] Created reservations ['f636b8f8-4be7-4706-a9fc-a4746a8431e4', '43331ec7-4605-4c10-a928-c5e0440364b0', '20430921-6437-4ac2-970c-49a0513ab2d3', '748b90e8-43d9-49bb-a828-d58a3f157521'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:38:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5ecdf25d-dcb0-4ba8-beb5-59ad784476be tempest-AttachVolumeNegativeTest-1941915072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5ecdf25d-dcb0-4ba8-beb5-59ad784476be tempest-AttachVolumeNegativeTest-1941915072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-5ecdf25d-dcb0-4ba8-beb5-59ad784476be tempest-AttachVolumeNegativeTest-1941915072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:38:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-5ecdf25d-dcb0-4ba8-beb5-59ad784476be tempest-AttachVolumeNegativeTest-1941915072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:38:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5ecdf25d-dcb0-4ba8-beb5-59ad784476be tempest-AttachVolumeNegativeTest-1941915072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5ecdf25d-dcb0-4ba8-beb5-59ad784476be tempest-AttachVolumeNegativeTest-1941915072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:02 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:38:02 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:02 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5ecdf25d-dcb0-4ba8-beb5-59ad784476be tempest-AttachVolumeNegativeTest-1941915072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.368s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:02 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-5ecdf25d-dcb0-4ba8-beb5-59ad784476be tempest-AttachVolumeNegativeTest-1941915072 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:38:02 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-5ecdf25d-dcb0-4ba8-beb5-59ad784476be tempest-AttachVolumeNegativeTest-1941915072 None] Deleted volume successfully. Nov 02 15:38:02 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5ecdf25d-dcb0-4ba8-beb5-59ad784476be tempest-AttachVolumeNegativeTest-1941915072 None] Lock "cinder-68552a60-ad42-46f5-a4bd-bd20650d5d83-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:38:02 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-995649f1-7a23-49ab-bf3a-a7b68ef57b53 tempest-AttachVolumeNegativeTest-1941915072 None] Acquiring lock "cinder-d66c5ad7-0747-4aa0-8aab-5653f29c0bbe-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:38:02 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-995649f1-7a23-49ab-bf3a-a7b68ef57b53 tempest-AttachVolumeNegativeTest-1941915072 None] Lock "cinder-d66c5ad7-0747-4aa0-8aab-5653f29c0bbe-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:38:02 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-995649f1-7a23-49ab-bf3a-a7b68ef57b53 tempest-AttachVolumeNegativeTest-1941915072 None] Acquiring lock "cinder-quobyte-d66c5ad7-0747-4aa0-8aab-5653f29c0bbe" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:38:02 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-995649f1-7a23-49ab-bf3a-a7b68ef57b53 tempest-AttachVolumeNegativeTest-1941915072 None] Lock "cinder-quobyte-d66c5ad7-0747-4aa0-8aab-5653f29c0bbe" acquired by "delete_volume" :: waited 0.028s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:38:02 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff06bd6-0ddc-4549-8805-66ac4658accc]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:38:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-995649f1-7a23-49ab-bf3a-a7b68ef57b53 tempest-AttachVolumeNegativeTest-1941915072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d66c5ad7-0747-4aa0-8aab-5653f29c0bbe {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:03 devstack sudo[98329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d66c5ad7-0747-4aa0-8aab-5653f29c0bbe Nov 02 15:38:03 devstack sudo[98329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:03 devstack sudo[98329]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-995649f1-7a23-49ab-bf3a-a7b68ef57b53 tempest-AttachVolumeNegativeTest-1941915072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d66c5ad7-0747-4aa0-8aab-5653f29c0bbe" returned: 0 in 0.598s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-995649f1-7a23-49ab-bf3a-a7b68ef57b53 tempest-AttachVolumeNegativeTest-1941915072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d66c5ad7-0747-4aa0-8aab-5653f29c0bbe {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:03 devstack sudo[98340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d66c5ad7-0747-4aa0-8aab-5653f29c0bbe Nov 02 15:38:03 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:03 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-995649f1-7a23-49ab-bf3a-a7b68ef57b53 tempest-AttachVolumeNegativeTest-1941915072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d66c5ad7-0747-4aa0-8aab-5653f29c0bbe" returned: 0 in 0.312s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-995649f1-7a23-49ab-bf3a-a7b68ef57b53 tempest-AttachVolumeNegativeTest-1941915072 None] Lock "cinder-quobyte-d66c5ad7-0747-4aa0-8aab-5653f29c0bbe" released by "delete_volume" :: held 0.997s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:38:04 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-995649f1-7a23-49ab-bf3a-a7b68ef57b53 tempest-AttachVolumeNegativeTest-1941915072 None] Created reservations ['7304bfbf-8f41-4eeb-98bd-34996ae9fa1e', 'e1bf290a-c374-45e9-94ef-d8c51e1be894', 'c323e8d0-b277-487e-a982-bfdc21fb3744', 'd0d83c94-250a-48ee-b86a-618724a136d5'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:38:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-995649f1-7a23-49ab-bf3a-a7b68ef57b53 tempest-AttachVolumeNegativeTest-1941915072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-995649f1-7a23-49ab-bf3a-a7b68ef57b53 tempest-AttachVolumeNegativeTest-1941915072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:04 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-995649f1-7a23-49ab-bf3a-a7b68ef57b53 tempest-AttachVolumeNegativeTest-1941915072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:38:04 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-995649f1-7a23-49ab-bf3a-a7b68ef57b53 tempest-AttachVolumeNegativeTest-1941915072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:38:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-995649f1-7a23-49ab-bf3a-a7b68ef57b53 tempest-AttachVolumeNegativeTest-1941915072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-995649f1-7a23-49ab-bf3a-a7b68ef57b53 tempest-AttachVolumeNegativeTest-1941915072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:04 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:38:04 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:04 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-995649f1-7a23-49ab-bf3a-a7b68ef57b53 tempest-AttachVolumeNegativeTest-1941915072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.386s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:04 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-995649f1-7a23-49ab-bf3a-a7b68ef57b53 tempest-AttachVolumeNegativeTest-1941915072 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:38:04 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-995649f1-7a23-49ab-bf3a-a7b68ef57b53 tempest-AttachVolumeNegativeTest-1941915072 None] Deleted volume successfully. Nov 02 15:38:04 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-995649f1-7a23-49ab-bf3a-a7b68ef57b53 tempest-AttachVolumeNegativeTest-1941915072 None] Lock "cinder-d66c5ad7-0747-4aa0-8aab-5653f29c0bbe-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:38:08 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-ba6185ba-c50c-45b5-94db-f35f447ac0f2 tempest-GroupsV314Test-1885977800 None] Group tempest-GroupsV314Test-Group-431708306: creating Nov 02 15:38:08 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-ba6185ba-c50c-45b5-94db-f35f447ac0f2 tempest-GroupsV314Test-1885977800 None] Group tempest-GroupsV314Test-Group-431708306: created successfully Nov 02 15:38:08 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-ba6185ba-c50c-45b5-94db-f35f447ac0f2 tempest-GroupsV314Test-1885977800 None] Create group completed successfully. Nov 02 15:38:09 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:38:09 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] Flow 'volume_create_manager' (a3bb4b88-24aa-4aad-8ffb-51f5ffed71b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:38:09 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a9ab27a-0330-47ca-84d7-36e650bca927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:09 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a9ab27a-0330-47ca-84d7-36e650bca927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1753193014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b17e6e9c-10ab-4ba0-b20d-1224d031c3c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ada10bbb07574638abedaca82f5198a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:38:09Z,use_quota=True,user_id='aade2713999a4853aa8c307b288c394f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:09 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d389fe1d-163a-424a-b1c2-5f2d1c08e7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:09 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d389fe1d-163a-424a-b1c2-5f2d1c08e7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:09 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99068f05-c930-462f-b87f-21a1967f4d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:09 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99068f05-c930-462f-b87f-21a1967f4d77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b17e6e9c-10ab-4ba0-b20d-1224d031c3c8', 'volume_name': 'volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:09 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c80b88d-ff08-4251-a2a1-c55e3835b5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:09 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c80b88d-ff08-4251-a2a1-c55e3835b5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:09 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eea917c5-3756-437d-aee8-dadd7aebe610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:09 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] Volume b17e6e9c-10ab-4ba0-b20d-1224d031c3c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8', 'volume_size': 1} Nov 02 15:38:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:09 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:38:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1753193014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b17e6e9c-10ab-4ba0-b20d-1224d031c3c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ada10bbb07574638abedaca82f5198a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:38:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:38:09Z,use_quota=True,user_id='aade2713999a4853aa8c307b288c394f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:38:09 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] Creating volume b17e6e9c-10ab-4ba0-b20d-1224d031c3c8 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:38:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:09 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:38:09 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:38:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:09 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:38:09 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:38:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:09 devstack sudo[98350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8 1073741824 Nov 02 15:38:09 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:10 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8 1073741824" returned: 0 in 0.786s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:10 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8 Nov 02 15:38:10 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:10 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8" returned: 0 in 0.311s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eea917c5-3756-437d-aee8-dadd7aebe610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (756b85af-8b42-4e0e-94b2-87b0046768bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] Flow 'volume_create_manager' (fce9165e-e66f-4921-bc6a-b002bc6b9b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d79605-0578-4d38-bf3c-c8ae67dc4da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:10 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] Volume volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8 (b17e6e9c-10ab-4ba0-b20d-1224d031c3c8): created successfully Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (756b85af-8b42-4e0e-94b2-87b0046768bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] Flow 'volume_create_manager' (a3bb4b88-24aa-4aad-8ffb-51f5ffed71b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d79605-0578-4d38-bf3c-c8ae67dc4da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-358588541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7ae4de3c-6308-40f2-872d-b66f5752271f,host='devstack@QuobyteHD#QuobyteHD',id=8468609f-b049-4565-8bb9-258b7f2fd4ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9a717392044d9aa6822098e6e450d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:38:11Z,use_quota=True,user_id='fe70458b8381469b996858fe7bb42edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24be7edd-57ae-485e-87d7-660a46338f60),volume_type_id=24be7edd-57ae-485e-87d7-660a46338f60)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22565d55-7112-4988-8c65-6a6352baf1d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22565d55-7112-4988-8c65-6a6352baf1d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4e069bd-8262-4ea9-ad79-53bd2bc48b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4e069bd-8262-4ea9-ad79-53bd2bc48b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8468609f-b049-4565-8bb9-258b7f2fd4ad', 'volume_name': 'volume-8468609f-b049-4565-8bb9-258b7f2fd4ad', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (534ec17e-5326-4c6e-bd1e-962614d4987d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (534ec17e-5326-4c6e-bd1e-962614d4987d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (befc83ed-43f8-458d-9450-2219c7184f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:10 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] Volume 8468609f-b049-4565-8bb9-258b7f2fd4ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8468609f-b049-4565-8bb9-258b7f2fd4ad', 'volume_size': 1} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7ae4de3c-6308-40f2-872d-b66f5752271f,created_at=2026-11-02T14:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-358588541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7ae4de3c-6308-40f2-872d-b66f5752271f,host='devstack@QuobyteHD#QuobyteHD',id=8468609f-b049-4565-8bb9-258b7f2fd4ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e9a717392044d9aa6822098e6e450d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:38:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:38:11Z,use_quota=True,user_id='fe70458b8381469b996858fe7bb42edd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24be7edd-57ae-485e-87d7-660a46338f60),volume_type_id=24be7edd-57ae-485e-87d7-660a46338f60)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] Creating volume 8468609f-b049-4565-8bb9-258b7f2fd4ad {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:38:10 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:38:10 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad 1073741824 Nov 02 15:38:10 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] Flow 'volume_create_manager' (f38e59de-74e5-4b70-ae4f-8498c0a82644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7db801c-3e97-482b-a0e3-e2653920f5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:10 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-69ff9c75-17f2-49c0-adae-f0d7f5a2e5de tempest-TestStampPattern-141219102 None] Created volume successfully. Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7db801c-3e97-482b-a0e3-e2653920f5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1927937912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bb3b5b0-cf51-4f2a-8193-26dae99e22fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd9dce2d802e481292f6f5cc59f1501b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:38:11Z,use_quota=True,user_id='8102da628d1942568f54ec1834e5f736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a77c185a-74e1-4f8b-b6df-196a92769b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a77c185a-74e1-4f8b-b6df-196a92769b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ccaf83f-5848-435c-bfd5-603cdb8b010f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ccaf83f-5848-435c-bfd5-603cdb8b010f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bb3b5b0-cf51-4f2a-8193-26dae99e22fb', 'volume_name': 'volume-1bb3b5b0-cf51-4f2a-8193-26dae99e22fb', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdbfe309-3b9e-419e-8f91-ce53a79fc79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdbfe309-3b9e-419e-8f91-ce53a79fc79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3743bee0-5302-4e11-b7ae-c1a2300c9289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:10 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] Volume 1bb3b5b0-cf51-4f2a-8193-26dae99e22fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bb3b5b0-cf51-4f2a-8193-26dae99e22fb', 'volume_size': 1} Nov 02 15:38:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:11 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad 1073741824" returned: 0 in 0.655s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:11 devstack sudo[98369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad Nov 02 15:38:11 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:11 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad" returned: 0 in 0.277s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:11 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:38:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.826s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:11 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1927937912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bb3b5b0-cf51-4f2a-8193-26dae99e22fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd9dce2d802e481292f6f5cc59f1501b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:38:11Z,use_quota=True,user_id='8102da628d1942568f54ec1834e5f736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:38:11 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] Creating volume 1bb3b5b0-cf51-4f2a-8193-26dae99e22fb {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:38:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:11 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:38:11 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:38:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:11 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:38:11 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:38:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1bb3b5b0-cf51-4f2a-8193-26dae99e22fb 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (befc83ed-43f8-458d-9450-2219c7184f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8468609f-b049-4565-8bb9-258b7f2fd4ad', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:11 devstack sudo[98372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1bb3b5b0-cf51-4f2a-8193-26dae99e22fb 1073741824 Nov 02 15:38:11 devstack sudo[98372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e63ba60-cecd-4fb2-94cf-f58364725ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:11 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] Volume volume-8468609f-b049-4565-8bb9-258b7f2fd4ad (8468609f-b049-4565-8bb9-258b7f2fd4ad): created successfully Nov 02 15:38:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e63ba60-cecd-4fb2-94cf-f58364725ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] Flow 'volume_create_manager' (fce9165e-e66f-4921-bc6a-b002bc6b9b3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:38:11 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-bca69345-61d1-4611-9d3c-b18fcadec045 tempest-GroupsV314Test-1885977800 None] Created volume successfully. Nov 02 15:38:12 devstack sudo[98372]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1bb3b5b0-cf51-4f2a-8193-26dae99e22fb 1073741824" returned: 0 in 0.679s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1bb3b5b0-cf51-4f2a-8193-26dae99e22fb {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:12 devstack sudo[98378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1bb3b5b0-cf51-4f2a-8193-26dae99e22fb Nov 02 15:38:12 devstack sudo[98378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:12 devstack sudo[98378]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1bb3b5b0-cf51-4f2a-8193-26dae99e22fb" returned: 0 in 0.343s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:38:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3743bee0-5302-4e11-b7ae-c1a2300c9289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bb3b5b0-cf51-4f2a-8193-26dae99e22fb', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd51071-da4e-4ef6-a982-20ec9ff3507b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:12 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] Volume volume-1bb3b5b0-cf51-4f2a-8193-26dae99e22fb (1bb3b5b0-cf51-4f2a-8193-26dae99e22fb): created successfully Nov 02 15:38:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebd51071-da4e-4ef6-a982-20ec9ff3507b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] Flow 'volume_create_manager' (f38e59de-74e5-4b70-ae4f-8498c0a82644) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:38:12 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-d300fb23-6197-48eb-9345-8a70f336b008 tempest-VolumesListAdminTestJSON-1661596657 None] Created volume successfully. Nov 02 15:38:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:13 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Cloning volume 8468609f-b049-4565-8bb9-258b7f2fd4ad to volume 36f5526e-f47c-416f-ad92-a5c725054882 Nov 02 15:38:13 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Creating offline snapshot 1091e4e1-812f-4748-b866-1122a555b817 of volume 8468609f-b049-4565-8bb9-258b7f2fd4ad {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:38:13 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8516a571-4910-403b-849b-8dd6a4886c9e]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:38:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:13 devstack sudo[98384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad Nov 02 15:38:13 devstack sudo[98384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:14 devstack sudo[98384]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad" returned: 0 in 0.832s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad.1091e4e1-812f-4748-b866-1122a555b817 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:14 devstack sudo[98401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad.1091e4e1-812f-4748-b866-1122a555b817 1G Nov 02 15:38:14 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:14 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:38:14 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] Flow 'volume_create_manager' (6b6a0c49-6745-42ae-8dae-13b0a50c3177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:38:14 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96ee6237-e113-4e0f-bf8d-be229cd02617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:14 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96ee6237-e113-4e0f-bf8d-be229cd02617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1348260605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e78b0b9-3d28-469d-8d86-acae9e3485f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd9dce2d802e481292f6f5cc59f1501b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:38:15Z,use_quota=True,user_id='8102da628d1942568f54ec1834e5f736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:14 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29a396e7-83f3-496c-a1f1-94c01d24d368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:14 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29a396e7-83f3-496c-a1f1-94c01d24d368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:14 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4015d43-e229-4249-b353-1c69fb2640d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:14 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4015d43-e229-4249-b353-1c69fb2640d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e78b0b9-3d28-469d-8d86-acae9e3485f9', 'volume_name': 'volume-3e78b0b9-3d28-469d-8d86-acae9e3485f9', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:14 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96138ffe-4b84-4627-8870-d1baa16be337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:14 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96138ffe-4b84-4627-8870-d1baa16be337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:14 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (760f04b7-b4c1-45bd-a8de-bd9cfc870305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:14 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] Volume 3e78b0b9-3d28-469d-8d86-acae9e3485f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e78b0b9-3d28-469d-8d86-acae9e3485f9', 'volume_size': 1} Nov 02 15:38:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:15 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad.1091e4e1-812f-4748-b866-1122a555b817 1G" returned: 0 in 0.670s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8468609f-b049-4565-8bb9-258b7f2fd4ad -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad.1091e4e1-812f-4748-b866-1122a555b817 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:15 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8468609f-b049-4565-8bb9-258b7f2fd4ad -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad.1091e4e1-812f-4748-b866-1122a555b817 Nov 02 15:38:15 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:15 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8468609f-b049-4565-8bb9-258b7f2fd4ad -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad.1091e4e1-812f-4748-b866-1122a555b817" returned: 0 in 0.359s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:15 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad.1091e4e1-812f-4748-b866-1122a555b817 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 15:38:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad.1091e4e1-812f-4748-b866-1122a555b817 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:15 devstack sudo[98413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad.1091e4e1-812f-4748-b866-1122a555b817 Nov 02 15:38:15 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:15 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad.1091e4e1-812f-4748-b866-1122a555b817" returned: 0 in 0.258s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:15 devstack sudo[98416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad.info Nov 02 15:38:15 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:16 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:38:16 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:16 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] Flow 'volume_create_manager' (994baeb4-1e25-47e0-b594-112e03c74e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:38:16 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798b3408-87e4-427e-a8df-e5abe09f6fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad.info" returned: 0 in 0.447s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:16 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 15:38:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:16 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (798b3408-87e4-427e-a8df-e5abe09f6fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-930637409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2350ad3-6c30-4acb-9944-8943677c7c65,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ab2aa680f5ee49c28b4458a7bd216f3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:38:16Z,use_quota=True,user_id='78cfff2ff9f04b52ad3b270fb7b899eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:16 devstack sudo[98420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad.info Nov 02 15:38:16 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:16 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (640fbd34-4732-44e1-8df9-ad79a3125868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:16 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (640fbd34-4732-44e1-8df9-ad79a3125868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:16 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce09a0b-3986-45f9-b4b0-cc71344bac48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:16 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cce09a0b-3986-45f9-b4b0-cc71344bac48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2350ad3-6c30-4acb-9944-8943677c7c65', 'volume_name': 'volume-d2350ad3-6c30-4acb-9944-8943677c7c65', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:16 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be0bad9-5fab-4b0f-ba77-70fbf20960fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:16 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be0bad9-5fab-4b0f-ba77-70fbf20960fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:16 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (032e887f-2be1-4281-bf23-be7357eca64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:16 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] Volume d2350ad3-6c30-4acb-9944-8943677c7c65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2350ad3-6c30-4acb-9944-8943677c7c65', 'volume_size': 1} Nov 02 15:38:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:16 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad.info" returned: 0 in 0.260s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:16 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Acquiring lock "cinder-quobyte-36f5526e-f47c-416f-ad92-a5c725054882" by "_copy_volume_from_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:38:16 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Lock "cinder-quobyte-36f5526e-f47c-416f-ad92-a5c725054882" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:38:16 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] snapshot: 1091e4e1-812f-4748-b866-1122a555b817, volume: 36f5526e-f47c-416f-ad92-a5c725054882, {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 15:38:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:16 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:38:16 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:38:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:16 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d85bc29-5d73-4721-8425-480b2ef32618]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:38:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad.1091e4e1-812f-4748-b866-1122a555b817 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:16 devstack sudo[98423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad.1091e4e1-812f-4748-b866-1122a555b817 Nov 02 15:38:16 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:17 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad.1091e4e1-812f-4748-b866-1122a555b817" returned: 0 in 0.614s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:17 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8468609f-b049-4565-8bb9-258b7f2fd4ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:38:17 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9849197-def9-463e-b1bc-6e17c43dd58d]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:38:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:17 devstack sudo[98477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad Nov 02 15:38:17 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:17 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad" returned: 0 in 0.520s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:17 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] will copy from snapshot at /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 15:38:17 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Creating direct copy from snapshot {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 15:38:17 devstack cinder-volume[86703]: DEBUG cinder.utils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Path /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-36f5526e-f47c-416f-ad92-a5c725054882 not found in is_blk_device check {{(pid=86703) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 15:38:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-36f5526e-f47c-416f-ad92-a5c725054882 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:17 devstack sudo[98496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-36f5526e-f47c-416f-ad92-a5c725054882 Nov 02 15:38:17 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:20 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:38:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:38:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:38:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:20 devstack sudo[98513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:38:20 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:21 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.724s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:21 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:38:21 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager._thread_info {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:38:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread count: 29 {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 15:38:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread info: [<_MainThread(MainThread, started 125876361756800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 15:38:26 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=28,cinder:INSERT=7,cinder:UPDATE=33,cinder:DELETE=4 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:38:26 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=33,cinder:UPDATE=39,cinder:INSERT=10,cinder:DELETE=2 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:38:27 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-36f5526e-f47c-416f-ad92-a5c725054882" returned: 0 in 9.560s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:27 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Image conversion details: src /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad, size 1024.00 MB, duration 9.56 sec, destination /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-36f5526e-f47c-416f-ad92-a5c725054882 {{(pid=86703) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 15:38:27 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Converted 1024.00 MB image at 107.10 MB/s Nov 02 15:38:27 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-36f5526e-f47c-416f-ad92-a5c725054882 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 15:38:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-36f5526e-f47c-416f-ad92-a5c725054882 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:27 devstack sudo[98522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-36f5526e-f47c-416f-ad92-a5c725054882 Nov 02 15:38:27 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:27 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-36f5526e-f47c-416f-ad92-a5c725054882" returned: 0 in 0.280s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Lock "cinder-quobyte-36f5526e-f47c-416f-ad92-a5c725054882" released by "_copy_volume_from_snapshot" :: held 11.137s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:38:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Acquiring lock "cinder-quobyte-1091e4e1-812f-4748-b866-1122a555b817" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:38:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Lock "cinder-quobyte-1091e4e1-812f-4748-b866-1122a555b817" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:38:27 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Deleting offline snapshot 1091e4e1-812f-4748-b866-1122a555b817 of volume 8468609f-b049-4565-8bb9-258b7f2fd4ad {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:38:27 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] snapshot_file for this snap is: volume-8468609f-b049-4565-8bb9-258b7f2fd4ad.1091e4e1-812f-4748-b866-1122a555b817 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:38:27 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ab5787-6fe4-4958-8f39-73fb49990dae]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:38:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad.1091e4e1-812f-4748-b866-1122a555b817 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:27 devstack sudo[98526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad.1091e4e1-812f-4748-b866-1122a555b817 Nov 02 15:38:27 devstack sudo[98526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:28 devstack sudo[98526]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad.1091e4e1-812f-4748-b866-1122a555b817" returned: 0 in 0.448s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8468609f-b049-4565-8bb9-258b7f2fd4ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:38:28 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a3d524-b7e5-405f-a9be-a7b64354e691]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:38:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:28 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad Nov 02 15:38:28 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:28 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad" returned: 0 in 0.526s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad.1091e4e1-812f-4748-b866-1122a555b817 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:28 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad.1091e4e1-812f-4748-b866-1122a555b817 Nov 02 15:38:28 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:29 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad.1091e4e1-812f-4748-b866-1122a555b817" returned: 0 in 0.349s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad.1091e4e1-812f-4748-b866-1122a555b817 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:29 devstack sudo[98542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad.1091e4e1-812f-4748-b866-1122a555b817 Nov 02 15:38:29 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:29 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad.1091e4e1-812f-4748-b866-1122a555b817" returned: 0 in 0.279s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:29 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Lock "cinder-quobyte-1091e4e1-812f-4748-b866-1122a555b817" released by "_delete_snapshot" :: held 1.751s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:38:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.030s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.628s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:38:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1348260605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e78b0b9-3d28-469d-8d86-acae9e3485f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd9dce2d802e481292f6f5cc59f1501b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:38:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:38:15Z,use_quota=True,user_id='8102da628d1942568f54ec1834e5f736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:38:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] Creating volume 3e78b0b9-3d28-469d-8d86-acae9e3485f9 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:38:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:38:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:38:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:38:29 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:38:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3e78b0b9-3d28-469d-8d86-acae9e3485f9 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:29 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3e78b0b9-3d28-469d-8d86-acae9e3485f9 1073741824 Nov 02 15:38:29 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:29 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-e58fd4ec-dce1-4260-a6f9-824e2bbdbd7e tempest-GroupsV314Test-1885977800 None] Create group from source-group-7ae4de3c-6308-40f2-872d-b66f5752271f completed successfully. Nov 02 15:38:29 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3e78b0b9-3d28-469d-8d86-acae9e3485f9 1073741824" returned: 0 in 0.447s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3e78b0b9-3d28-469d-8d86-acae9e3485f9 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:30 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3e78b0b9-3d28-469d-8d86-acae9e3485f9 Nov 02 15:38:30 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:30 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3e78b0b9-3d28-469d-8d86-acae9e3485f9" returned: 0 in 0.250s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:38:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.960s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-930637409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2350ad3-6c30-4acb-9944-8943677c7c65,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ab2aa680f5ee49c28b4458a7bd216f3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:38:16Z,use_quota=True,user_id='78cfff2ff9f04b52ad3b270fb7b899eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:38:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] Creating volume d2350ad3-6c30-4acb-9944-8943677c7c65 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:38:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:38:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:38:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:38:30 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:38:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d2350ad3-6c30-4acb-9944-8943677c7c65 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:30 devstack sudo[98553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d2350ad3-6c30-4acb-9944-8943677c7c65 1073741824 Nov 02 15:38:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (760f04b7-b4c1-45bd-a8de-bd9cfc870305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e78b0b9-3d28-469d-8d86-acae9e3485f9', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:30 devstack sudo[98553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcd0ccd8-1b5d-432c-a1d4-d76b0ff1dd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:30 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] Volume volume-3e78b0b9-3d28-469d-8d86-acae9e3485f9 (3e78b0b9-3d28-469d-8d86-acae9e3485f9): created successfully Nov 02 15:38:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcd0ccd8-1b5d-432c-a1d4-d76b0ff1dd59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] Flow 'volume_create_manager' (6b6a0c49-6745-42ae-8dae-13b0a50c3177) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:38:30 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-35f44b2a-ee79-48ba-9cf8-4307366499a7 tempest-VolumesListAdminTestJSON-1661596657 None] Created volume successfully. Nov 02 15:38:30 devstack sudo[98553]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d2350ad3-6c30-4acb-9944-8943677c7c65 1073741824" returned: 0 in 0.669s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d2350ad3-6c30-4acb-9944-8943677c7c65 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:31 devstack sudo[98581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d2350ad3-6c30-4acb-9944-8943677c7c65 Nov 02 15:38:31 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-9e979836-9f96-44c8-80c2-b3a3eef90445 tempest-GroupsV314Test-1885977800 None] Acquiring lock "cinder-quobyte-36f5526e-f47c-416f-ad92-a5c725054882" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-9e979836-9f96-44c8-80c2-b3a3eef90445 tempest-GroupsV314Test-1885977800 None] Lock "cinder-quobyte-36f5526e-f47c-416f-ad92-a5c725054882" acquired by "delete_volume" :: waited 0.044s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0cace4-63ab-4bcb-a17a-70899276c0d2]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9e979836-9f96-44c8-80c2-b3a3eef90445 tempest-GroupsV314Test-1885977800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-36f5526e-f47c-416f-ad92-a5c725054882 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] Flow 'volume_create_manager' (ae018bf9-b5c9-4737-b73f-1a042fbcfddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c76273-281b-4cf4-be50-9636b9190b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c76273-281b-4cf4-be50-9636b9190b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1036012901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f363d1c-8b7e-434f-9eef-4cdb8bad4068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd9dce2d802e481292f6f5cc59f1501b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:38:31Z,use_quota=True,user_id='8102da628d1942568f54ec1834e5f736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbb072c3-87c3-42b1-8764-39d4d54dcbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bbb072c3-87c3-42b1-8764-39d4d54dcbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2b120ee-26e7-4183-89f0-3888ddbe4fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2b120ee-26e7-4183-89f0-3888ddbe4fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f363d1c-8b7e-434f-9eef-4cdb8bad4068', 'volume_name': 'volume-8f363d1c-8b7e-434f-9eef-4cdb8bad4068', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99753326-9d8d-485c-9a3f-cbf5888f9729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99753326-9d8d-485c-9a3f-cbf5888f9729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd7ce460-ef59-47c2-9701-8de2563fd7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:31 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] Volume 8f363d1c-8b7e-434f-9eef-4cdb8bad4068: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f363d1c-8b7e-434f-9eef-4cdb8bad4068', 'volume_size': 1} Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:31 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-36f5526e-f47c-416f-ad92-a5c725054882 Nov 02 15:38:31 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:31 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d2350ad3-6c30-4acb-9944-8943677c7c65" returned: 0 in 0.394s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.021s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:38:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1036012901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f363d1c-8b7e-434f-9eef-4cdb8bad4068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd9dce2d802e481292f6f5cc59f1501b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:38:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:38:31Z,use_quota=True,user_id='8102da628d1942568f54ec1834e5f736',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] Creating volume 8f363d1c-8b7e-434f-9eef-4cdb8bad4068 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:38:31 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8f363d1c-8b7e-434f-9eef-4cdb8bad4068 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (032e887f-2be1-4281-bf23-be7357eca64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2350ad3-6c30-4acb-9944-8943677c7c65', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (217a5e25-aa29-466c-8c28-2db865d55580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:31 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8f363d1c-8b7e-434f-9eef-4cdb8bad4068 1073741824 Nov 02 15:38:31 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:31 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] Volume volume-d2350ad3-6c30-4acb-9944-8943677c7c65 (d2350ad3-6c30-4acb-9944-8943677c7c65): created successfully Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (217a5e25-aa29-466c-8c28-2db865d55580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] Flow 'volume_create_manager' (994baeb4-1e25-47e0-b594-112e03c74e32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:38:31 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-8be64696-3474-42a8-8ebc-82a61ce0e461 req-fe967df5-56e6-4a52-a010-5026d4730926 tempest-VolumesGetTestJSON-914985080 None] Created volume successfully. Nov 02 15:38:31 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9e979836-9f96-44c8-80c2-b3a3eef90445 tempest-GroupsV314Test-1885977800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-36f5526e-f47c-416f-ad92-a5c725054882" returned: 0 in 0.433s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9e979836-9f96-44c8-80c2-b3a3eef90445 tempest-GroupsV314Test-1885977800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-36f5526e-f47c-416f-ad92-a5c725054882 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:31 devstack sudo[98594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-36f5526e-f47c-416f-ad92-a5c725054882 Nov 02 15:38:31 devstack sudo[98594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:31 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8f363d1c-8b7e-434f-9eef-4cdb8bad4068 1073741824" returned: 0 in 0.486s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8f363d1c-8b7e-434f-9eef-4cdb8bad4068 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:31 devstack sudo[98594]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9e979836-9f96-44c8-80c2-b3a3eef90445 tempest-GroupsV314Test-1885977800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-36f5526e-f47c-416f-ad92-a5c725054882" returned: 0 in 0.262s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:31 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8f363d1c-8b7e-434f-9eef-4cdb8bad4068 Nov 02 15:38:31 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:31 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-9e979836-9f96-44c8-80c2-b3a3eef90445 tempest-GroupsV314Test-1885977800 None] Lock "cinder-quobyte-36f5526e-f47c-416f-ad92-a5c725054882" released by "delete_volume" :: held 0.763s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:38:32 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-9e979836-9f96-44c8-80c2-b3a3eef90445 tempest-GroupsV314Test-1885977800 None] Created reservations ['3e400478-6469-4634-ab94-ecf8e89a9fd8'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:38:32 devstack cinder-volume[86703]: WARNING cinder.quota [None req-9e979836-9f96-44c8-80c2-b3a3eef90445 tempest-GroupsV314Test-1885977800 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-117855477 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-117855477, it is now deprecated. Please use the default quota class for default quota. Nov 02 15:38:32 devstack cinder-volume[86703]: WARNING cinder.quota [None req-9e979836-9f96-44c8-80c2-b3a3eef90445 tempest-GroupsV314Test-1885977800 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-117855477 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-117855477, it is now deprecated. Please use the default quota class for default quota. Nov 02 15:38:32 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-9e979836-9f96-44c8-80c2-b3a3eef90445 tempest-GroupsV314Test-1885977800 None] Created reservations ['3fd0f76a-405a-414f-8628-30531c295521', '15c14355-f1b5-4c5b-b217-a93c63957e22', '23e8d58e-f1fa-4cd1-8adb-20efcafac9cd', '9a7b6555-5d74-4b4b-a1c6-8791ace8a2ee'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:38:32 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8f363d1c-8b7e-434f-9eef-4cdb8bad4068" returned: 0 in 0.256s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:38:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9e979836-9f96-44c8-80c2-b3a3eef90445 tempest-GroupsV314Test-1885977800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9e979836-9f96-44c8-80c2-b3a3eef90445 tempest-GroupsV314Test-1885977800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9e979836-9f96-44c8-80c2-b3a3eef90445 tempest-GroupsV314Test-1885977800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:38:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9e979836-9f96-44c8-80c2-b3a3eef90445 tempest-GroupsV314Test-1885977800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:38:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9e979836-9f96-44c8-80c2-b3a3eef90445 tempest-GroupsV314Test-1885977800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9e979836-9f96-44c8-80c2-b3a3eef90445 tempest-GroupsV314Test-1885977800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd7ce460-ef59-47c2-9701-8de2563fd7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f363d1c-8b7e-434f-9eef-4cdb8bad4068', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62ee13ef-38da-44bb-93d0-a983ba2b7a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:32 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:38:32 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:32 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] Volume volume-8f363d1c-8b7e-434f-9eef-4cdb8bad4068 (8f363d1c-8b7e-434f-9eef-4cdb8bad4068): created successfully Nov 02 15:38:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62ee13ef-38da-44bb-93d0-a983ba2b7a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] Flow 'volume_create_manager' (ae018bf9-b5c9-4737-b73f-1a042fbcfddf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:38:32 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-5587ba48-8cf7-4697-8d52-9a9d7f950d64 tempest-VolumesListAdminTestJSON-1661596657 None] Created volume successfully. Nov 02 15:38:32 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9e979836-9f96-44c8-80c2-b3a3eef90445 tempest-GroupsV314Test-1885977800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.277s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:32 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-9e979836-9f96-44c8-80c2-b3a3eef90445 tempest-GroupsV314Test-1885977800 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:38:32 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-9e979836-9f96-44c8-80c2-b3a3eef90445 tempest-GroupsV314Test-1885977800 None] Delete group completed successfully. Nov 02 15:38:32 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-116e63e6-61ca-415c-a0c7-8b1da2afe8c1 tempest-GroupsV314Test-1885977800 None] Acquiring lock "cinder-quobyte-8468609f-b049-4565-8bb9-258b7f2fd4ad" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:38:32 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-116e63e6-61ca-415c-a0c7-8b1da2afe8c1 tempest-GroupsV314Test-1885977800 None] Lock "cinder-quobyte-8468609f-b049-4565-8bb9-258b7f2fd4ad" acquired by "delete_volume" :: waited 0.026s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:38:32 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e918b6f-59f5-4254-a667-00bfddbfdddd]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:38:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-116e63e6-61ca-415c-a0c7-8b1da2afe8c1 tempest-GroupsV314Test-1885977800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:32 devstack cinder-volume[86703]: DEBUG cinder.coordination [req-8ff97e63-cb57-4d29-b725-979772be248a req-56c154d6-3420-4c05-ad62-a682ebb1fd96 tempest-VolumesGetTestJSON-914985080 None] Acquiring lock "cinder-d2350ad3-6c30-4acb-9944-8943677c7c65-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:38:32 devstack cinder-volume[86703]: DEBUG cinder.coordination [req-8ff97e63-cb57-4d29-b725-979772be248a req-56c154d6-3420-4c05-ad62-a682ebb1fd96 tempest-VolumesGetTestJSON-914985080 None] Lock "cinder-d2350ad3-6c30-4acb-9944-8943677c7c65-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:38:32 devstack sudo[98603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad Nov 02 15:38:32 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:32 devstack cinder-volume[86703]: DEBUG cinder.coordination [req-8ff97e63-cb57-4d29-b725-979772be248a req-56c154d6-3420-4c05-ad62-a682ebb1fd96 tempest-VolumesGetTestJSON-914985080 None] Acquiring lock "cinder-quobyte-d2350ad3-6c30-4acb-9944-8943677c7c65" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:38:32 devstack cinder-volume[86703]: DEBUG cinder.coordination [req-8ff97e63-cb57-4d29-b725-979772be248a req-56c154d6-3420-4c05-ad62-a682ebb1fd96 tempest-VolumesGetTestJSON-914985080 None] Lock "cinder-quobyte-d2350ad3-6c30-4acb-9944-8943677c7c65" acquired by "delete_volume" :: waited 0.021s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:38:32 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[02568970-dd08-45e1-ab0c-01cd6695ffd7]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:38:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-8ff97e63-cb57-4d29-b725-979772be248a req-56c154d6-3420-4c05-ad62-a682ebb1fd96 tempest-VolumesGetTestJSON-914985080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d2350ad3-6c30-4acb-9944-8943677c7c65 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:33 devstack sudo[98605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d2350ad3-6c30-4acb-9944-8943677c7c65 Nov 02 15:38:33 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:33 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-116e63e6-61ca-415c-a0c7-8b1da2afe8c1 tempest-GroupsV314Test-1885977800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad" returned: 0 in 0.382s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-116e63e6-61ca-415c-a0c7-8b1da2afe8c1 tempest-GroupsV314Test-1885977800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:33 devstack sudo[98610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad Nov 02 15:38:33 devstack sudo[98610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:33 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-8ff97e63-cb57-4d29-b725-979772be248a req-56c154d6-3420-4c05-ad62-a682ebb1fd96 tempest-VolumesGetTestJSON-914985080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d2350ad3-6c30-4acb-9944-8943677c7c65" returned: 0 in 0.380s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-8ff97e63-cb57-4d29-b725-979772be248a req-56c154d6-3420-4c05-ad62-a682ebb1fd96 tempest-VolumesGetTestJSON-914985080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d2350ad3-6c30-4acb-9944-8943677c7c65 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:33 devstack sudo[98615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d2350ad3-6c30-4acb-9944-8943677c7c65 Nov 02 15:38:33 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:33 devstack sudo[98610]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-116e63e6-61ca-415c-a0c7-8b1da2afe8c1 tempest-GroupsV314Test-1885977800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8468609f-b049-4565-8bb9-258b7f2fd4ad" returned: 0 in 0.280s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-116e63e6-61ca-415c-a0c7-8b1da2afe8c1 tempest-GroupsV314Test-1885977800 None] Lock "cinder-quobyte-8468609f-b049-4565-8bb9-258b7f2fd4ad" released by "delete_volume" :: held 0.754s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:38:33 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-116e63e6-61ca-415c-a0c7-8b1da2afe8c1 tempest-GroupsV314Test-1885977800 None] Created reservations ['5dc1c7c3-3176-4284-8f40-c4db7c24b8be'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:38:33 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-116e63e6-61ca-415c-a0c7-8b1da2afe8c1 tempest-GroupsV314Test-1885977800 None] Created reservations ['f50b39e7-a8f3-4f94-84b2-0d3b19921825', '3bb60200-d9e9-4190-8847-7b237e168f93', 'ac1cb678-cf4f-43b8-8234-43db00a2588a', 'cd795d5d-f6a5-40f1-88f8-d70671931f79'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:38:33 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-8ff97e63-cb57-4d29-b725-979772be248a req-56c154d6-3420-4c05-ad62-a682ebb1fd96 tempest-VolumesGetTestJSON-914985080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d2350ad3-6c30-4acb-9944-8943677c7c65" returned: 0 in 0.303s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [req-8ff97e63-cb57-4d29-b725-979772be248a req-56c154d6-3420-4c05-ad62-a682ebb1fd96 tempest-VolumesGetTestJSON-914985080 None] Lock "cinder-quobyte-d2350ad3-6c30-4acb-9944-8943677c7c65" released by "delete_volume" :: held 0.731s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:38:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-116e63e6-61ca-415c-a0c7-8b1da2afe8c1 tempest-GroupsV314Test-1885977800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-116e63e6-61ca-415c-a0c7-8b1da2afe8c1 tempest-GroupsV314Test-1885977800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-116e63e6-61ca-415c-a0c7-8b1da2afe8c1 tempest-GroupsV314Test-1885977800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:38:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-116e63e6-61ca-415c-a0c7-8b1da2afe8c1 tempest-GroupsV314Test-1885977800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:38:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-116e63e6-61ca-415c-a0c7-8b1da2afe8c1 tempest-GroupsV314Test-1885977800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-116e63e6-61ca-415c-a0c7-8b1da2afe8c1 tempest-GroupsV314Test-1885977800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:33 devstack sudo[98619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:38:33 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:33 devstack cinder-volume[86703]: DEBUG cinder.quota [req-8ff97e63-cb57-4d29-b725-979772be248a req-56c154d6-3420-4c05-ad62-a682ebb1fd96 tempest-VolumesGetTestJSON-914985080 None] Created reservations ['9f3a79c6-f6c4-49bf-bf13-7e1673651654', '16daf715-d2e8-4cfa-afb7-4928c1432fe9', 'daef8c3a-3258-4ef7-b7f4-d8c39b6f0868', '0e94fbde-50dd-4322-af88-9f36dd8a25ce'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:38:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-8ff97e63-cb57-4d29-b725-979772be248a req-56c154d6-3420-4c05-ad62-a682ebb1fd96 tempest-VolumesGetTestJSON-914985080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-8ff97e63-cb57-4d29-b725-979772be248a req-56c154d6-3420-4c05-ad62-a682ebb1fd96 tempest-VolumesGetTestJSON-914985080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [req-8ff97e63-cb57-4d29-b725-979772be248a req-56c154d6-3420-4c05-ad62-a682ebb1fd96 tempest-VolumesGetTestJSON-914985080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:38:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [req-8ff97e63-cb57-4d29-b725-979772be248a req-56c154d6-3420-4c05-ad62-a682ebb1fd96 tempest-VolumesGetTestJSON-914985080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:38:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-8ff97e63-cb57-4d29-b725-979772be248a req-56c154d6-3420-4c05-ad62-a682ebb1fd96 tempest-VolumesGetTestJSON-914985080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-8ff97e63-cb57-4d29-b725-979772be248a req-56c154d6-3420-4c05-ad62-a682ebb1fd96 tempest-VolumesGetTestJSON-914985080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:33 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:38:33 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:33 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-116e63e6-61ca-415c-a0c7-8b1da2afe8c1 tempest-GroupsV314Test-1885977800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.325s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:34 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-116e63e6-61ca-415c-a0c7-8b1da2afe8c1 tempest-GroupsV314Test-1885977800 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:38:34 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-116e63e6-61ca-415c-a0c7-8b1da2afe8c1 tempest-GroupsV314Test-1885977800 None] Delete group completed successfully. Nov 02 15:38:34 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-8ff97e63-cb57-4d29-b725-979772be248a req-56c154d6-3420-4c05-ad62-a682ebb1fd96 tempest-VolumesGetTestJSON-914985080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.356s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:34 devstack cinder-volume[86703]: DEBUG cinder.manager [req-8ff97e63-cb57-4d29-b725-979772be248a req-56c154d6-3420-4c05-ad62-a682ebb1fd96 tempest-VolumesGetTestJSON-914985080 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:38:34 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-8ff97e63-cb57-4d29-b725-979772be248a req-56c154d6-3420-4c05-ad62-a682ebb1fd96 tempest-VolumesGetTestJSON-914985080 None] Deleted volume successfully. Nov 02 15:38:34 devstack cinder-volume[86703]: DEBUG cinder.coordination [req-8ff97e63-cb57-4d29-b725-979772be248a req-56c154d6-3420-4c05-ad62-a682ebb1fd96 tempest-VolumesGetTestJSON-914985080 None] Lock "cinder-d2350ad3-6c30-4acb-9944-8943677c7c65-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:38:34 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:38:34 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] Flow 'volume_create_manager' (cc153a49-640e-4fb6-9121-99fd2eb40814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:38:34 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e7c3e6a-52ee-46f3-b8bf-73bc8988d8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:34 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e7c3e6a-52ee-46f3-b8bf-73bc8988d8a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85794cb7-7d8a-46c1-adb3-3ef95c886ca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863a86161932434bb383d506e8177099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:38:34Z,use_quota=True,user_id='50bba1f9fd344cad94e1fdfa54b615dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:34 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (042302ed-1527-45b3-a188-d52c46a6f27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:34 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (042302ed-1527-45b3-a188-d52c46a6f27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:34 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c05ab22-673d-4a91-a55d-ba6557fdc20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:34 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c05ab22-673d-4a91-a55d-ba6557fdc20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85794cb7-7d8a-46c1-adb3-3ef95c886ca7', 'volume_name': 'volume-85794cb7-7d8a-46c1-adb3-3ef95c886ca7', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:34 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a411d58-9f46-4b7c-8804-2e3391280c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:34 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a411d58-9f46-4b7c-8804-2e3391280c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:34 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdb7acd8-3c28-49e9-9211-2be8d95fa349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:34 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] Volume 85794cb7-7d8a-46c1-adb3-3ef95c886ca7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85794cb7-7d8a-46c1-adb3-3ef95c886ca7', 'volume_size': 1} Nov 02 15:38:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:34 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85794cb7-7d8a-46c1-adb3-3ef95c886ca7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='863a86161932434bb383d506e8177099',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:38:34Z,use_quota=True,user_id='50bba1f9fd344cad94e1fdfa54b615dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:38:34 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] Creating volume 85794cb7-7d8a-46c1-adb3-3ef95c886ca7 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:38:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:34 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:38:34 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:38:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:34 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:38:34 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:38:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-85794cb7-7d8a-46c1-adb3-3ef95c886ca7 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:34 devstack sudo[98625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-85794cb7-7d8a-46c1-adb3-3ef95c886ca7 1073741824 Nov 02 15:38:34 devstack sudo[98625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:35 devstack sudo[98625]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-85794cb7-7d8a-46c1-adb3-3ef95c886ca7 1073741824" returned: 0 in 0.472s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-85794cb7-7d8a-46c1-adb3-3ef95c886ca7 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:35 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-85794cb7-7d8a-46c1-adb3-3ef95c886ca7 Nov 02 15:38:35 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:35 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-85794cb7-7d8a-46c1-adb3-3ef95c886ca7" returned: 0 in 0.285s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:35 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:38:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:35 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdb7acd8-3c28-49e9-9211-2be8d95fa349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85794cb7-7d8a-46c1-adb3-3ef95c886ca7', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:35 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3163932-847d-4088-b9e1-09fbbec565b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:35 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] Volume volume-85794cb7-7d8a-46c1-adb3-3ef95c886ca7 (85794cb7-7d8a-46c1-adb3-3ef95c886ca7): created successfully Nov 02 15:38:35 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3163932-847d-4088-b9e1-09fbbec565b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:35 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] Flow 'volume_create_manager' (cc153a49-640e-4fb6-9121-99fd2eb40814) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:38:35 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-65f37747-bc13-4691-a0e8-3ad2f4f0ef8d tempest-VolumesListAdminTestJSON-1934688975 None] Created volume successfully. Nov 02 15:38:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-60883372-9a21-4295-9614-a4b12479bd7e tempest-VolumesListAdminTestJSON-1934688975 None] Acquiring lock "cinder-85794cb7-7d8a-46c1-adb3-3ef95c886ca7-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:38:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-60883372-9a21-4295-9614-a4b12479bd7e tempest-VolumesListAdminTestJSON-1934688975 None] Lock "cinder-85794cb7-7d8a-46c1-adb3-3ef95c886ca7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:38:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-60883372-9a21-4295-9614-a4b12479bd7e tempest-VolumesListAdminTestJSON-1934688975 None] Acquiring lock "cinder-quobyte-85794cb7-7d8a-46c1-adb3-3ef95c886ca7" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:38:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-60883372-9a21-4295-9614-a4b12479bd7e tempest-VolumesListAdminTestJSON-1934688975 None] Lock "cinder-quobyte-85794cb7-7d8a-46c1-adb3-3ef95c886ca7" acquired by "delete_volume" :: waited 0.025s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:38:36 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafae5dd-3252-4c6b-bc9c-06de33cbfa27]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:38:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-60883372-9a21-4295-9614-a4b12479bd7e tempest-VolumesListAdminTestJSON-1934688975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-85794cb7-7d8a-46c1-adb3-3ef95c886ca7 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0f1faa60-f4b9-4126-bfb0-51928856d362 tempest-VolumesListAdminTestJSON-1661596657 None] Acquiring lock "cinder-8f363d1c-8b7e-434f-9eef-4cdb8bad4068-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:38:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0f1faa60-f4b9-4126-bfb0-51928856d362 tempest-VolumesListAdminTestJSON-1661596657 None] Lock "cinder-8f363d1c-8b7e-434f-9eef-4cdb8bad4068-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:38:36 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-85794cb7-7d8a-46c1-adb3-3ef95c886ca7 Nov 02 15:38:36 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0f1faa60-f4b9-4126-bfb0-51928856d362 tempest-VolumesListAdminTestJSON-1661596657 None] Acquiring lock "cinder-quobyte-8f363d1c-8b7e-434f-9eef-4cdb8bad4068" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:38:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0f1faa60-f4b9-4126-bfb0-51928856d362 tempest-VolumesListAdminTestJSON-1661596657 None] Lock "cinder-quobyte-8f363d1c-8b7e-434f-9eef-4cdb8bad4068" acquired by "delete_volume" :: waited 0.028s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:38:37 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a263dff-c481-4f0f-94d0-59745e64d8a7]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:38:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0f1faa60-f4b9-4126-bfb0-51928856d362 tempest-VolumesListAdminTestJSON-1661596657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8f363d1c-8b7e-434f-9eef-4cdb8bad4068 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:37 devstack sudo[98638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8f363d1c-8b7e-434f-9eef-4cdb8bad4068 Nov 02 15:38:37 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:37 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-60883372-9a21-4295-9614-a4b12479bd7e tempest-VolumesListAdminTestJSON-1934688975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-85794cb7-7d8a-46c1-adb3-3ef95c886ca7" returned: 0 in 0.490s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-60883372-9a21-4295-9614-a4b12479bd7e tempest-VolumesListAdminTestJSON-1934688975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-85794cb7-7d8a-46c1-adb3-3ef95c886ca7 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:37 devstack sudo[98644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-85794cb7-7d8a-46c1-adb3-3ef95c886ca7 Nov 02 15:38:37 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:37 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0f1faa60-f4b9-4126-bfb0-51928856d362 tempest-VolumesListAdminTestJSON-1661596657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8f363d1c-8b7e-434f-9eef-4cdb8bad4068" returned: 0 in 0.537s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0f1faa60-f4b9-4126-bfb0-51928856d362 tempest-VolumesListAdminTestJSON-1661596657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8f363d1c-8b7e-434f-9eef-4cdb8bad4068 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:37 devstack sudo[98650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8f363d1c-8b7e-434f-9eef-4cdb8bad4068 Nov 02 15:38:37 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:37 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-60883372-9a21-4295-9614-a4b12479bd7e tempest-VolumesListAdminTestJSON-1934688975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-85794cb7-7d8a-46c1-adb3-3ef95c886ca7" returned: 0 in 0.359s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:37 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-60883372-9a21-4295-9614-a4b12479bd7e tempest-VolumesListAdminTestJSON-1934688975 None] Lock "cinder-quobyte-85794cb7-7d8a-46c1-adb3-3ef95c886ca7" released by "delete_volume" :: held 0.916s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:38:37 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-60883372-9a21-4295-9614-a4b12479bd7e tempest-VolumesListAdminTestJSON-1934688975 None] Created reservations ['35e6b8ed-457d-456b-99a6-914adc20a91e', 'add0e6be-3b0f-457f-b2aa-e0596faa2a73', '4f2f7a44-9261-47d5-9081-88c0de0c18fd', '6f232f7c-7681-4b06-be95-15fb9cc2f369'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:38:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-60883372-9a21-4295-9614-a4b12479bd7e tempest-VolumesListAdminTestJSON-1934688975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-60883372-9a21-4295-9614-a4b12479bd7e tempest-VolumesListAdminTestJSON-1934688975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-60883372-9a21-4295-9614-a4b12479bd7e tempest-VolumesListAdminTestJSON-1934688975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:38:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-60883372-9a21-4295-9614-a4b12479bd7e tempest-VolumesListAdminTestJSON-1934688975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:38:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-60883372-9a21-4295-9614-a4b12479bd7e tempest-VolumesListAdminTestJSON-1934688975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-60883372-9a21-4295-9614-a4b12479bd7e tempest-VolumesListAdminTestJSON-1934688975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:37 devstack sudo[98653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:38:37 devstack sudo[98653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:37 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0f1faa60-f4b9-4126-bfb0-51928856d362 tempest-VolumesListAdminTestJSON-1661596657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8f363d1c-8b7e-434f-9eef-4cdb8bad4068" returned: 0 in 0.353s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:37 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0f1faa60-f4b9-4126-bfb0-51928856d362 tempest-VolumesListAdminTestJSON-1661596657 None] Lock "cinder-quobyte-8f363d1c-8b7e-434f-9eef-4cdb8bad4068" released by "delete_volume" :: held 0.962s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:38:38 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-0f1faa60-f4b9-4126-bfb0-51928856d362 tempest-VolumesListAdminTestJSON-1661596657 None] Created reservations ['d2ac5da1-38a0-4cb8-b1e7-e6b95babfd7d', '60b56f1f-825b-48b2-8d1d-1122f1a830a7', 'cfce4f53-5fbd-43cf-8cfb-de11f6362be2', '5f137a39-c764-4715-8c6b-a6e99b281a38'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:38:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0f1faa60-f4b9-4126-bfb0-51928856d362 tempest-VolumesListAdminTestJSON-1661596657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0f1faa60-f4b9-4126-bfb0-51928856d362 tempest-VolumesListAdminTestJSON-1661596657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-0f1faa60-f4b9-4126-bfb0-51928856d362 tempest-VolumesListAdminTestJSON-1661596657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:38:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-0f1faa60-f4b9-4126-bfb0-51928856d362 tempest-VolumesListAdminTestJSON-1661596657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:38:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0f1faa60-f4b9-4126-bfb0-51928856d362 tempest-VolumesListAdminTestJSON-1661596657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0f1faa60-f4b9-4126-bfb0-51928856d362 tempest-VolumesListAdminTestJSON-1661596657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:38 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:38:38 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-60883372-9a21-4295-9614-a4b12479bd7e tempest-VolumesListAdminTestJSON-1934688975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.381s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:38 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-60883372-9a21-4295-9614-a4b12479bd7e tempest-VolumesListAdminTestJSON-1934688975 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:38:38 devstack sudo[98653]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:38 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-60883372-9a21-4295-9614-a4b12479bd7e tempest-VolumesListAdminTestJSON-1934688975 None] Deleted volume successfully. Nov 02 15:38:38 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-60883372-9a21-4295-9614-a4b12479bd7e tempest-VolumesListAdminTestJSON-1934688975 None] Lock "cinder-85794cb7-7d8a-46c1-adb3-3ef95c886ca7-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:38:38 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0f1faa60-f4b9-4126-bfb0-51928856d362 tempest-VolumesListAdminTestJSON-1661596657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.391s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:38 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-0f1faa60-f4b9-4126-bfb0-51928856d362 tempest-VolumesListAdminTestJSON-1661596657 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:38:38 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-0f1faa60-f4b9-4126-bfb0-51928856d362 tempest-VolumesListAdminTestJSON-1661596657 None] Deleted volume successfully. Nov 02 15:38:38 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0f1faa60-f4b9-4126-bfb0-51928856d362 tempest-VolumesListAdminTestJSON-1661596657 None] Lock "cinder-8f363d1c-8b7e-434f-9eef-4cdb8bad4068-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:38:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f3e7c70b-d201-4d7f-817e-d71914115ee7 tempest-VolumesListAdminTestJSON-1661596657 None] Acquiring lock "cinder-3e78b0b9-3d28-469d-8d86-acae9e3485f9-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:38:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f3e7c70b-d201-4d7f-817e-d71914115ee7 tempest-VolumesListAdminTestJSON-1661596657 None] Lock "cinder-3e78b0b9-3d28-469d-8d86-acae9e3485f9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:38:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f3e7c70b-d201-4d7f-817e-d71914115ee7 tempest-VolumesListAdminTestJSON-1661596657 None] Acquiring lock "cinder-quobyte-3e78b0b9-3d28-469d-8d86-acae9e3485f9" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:38:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f3e7c70b-d201-4d7f-817e-d71914115ee7 tempest-VolumesListAdminTestJSON-1661596657 None] Lock "cinder-quobyte-3e78b0b9-3d28-469d-8d86-acae9e3485f9" acquired by "delete_volume" :: waited 0.029s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:38:39 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[451f6066-d1fc-413a-b473-c3ed3de1372f]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:38:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f3e7c70b-d201-4d7f-817e-d71914115ee7 tempest-VolumesListAdminTestJSON-1661596657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3e78b0b9-3d28-469d-8d86-acae9e3485f9 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:39 devstack sudo[98659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3e78b0b9-3d28-469d-8d86-acae9e3485f9 Nov 02 15:38:39 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:40 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f3e7c70b-d201-4d7f-817e-d71914115ee7 tempest-VolumesListAdminTestJSON-1661596657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3e78b0b9-3d28-469d-8d86-acae9e3485f9" returned: 0 in 0.471s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f3e7c70b-d201-4d7f-817e-d71914115ee7 tempest-VolumesListAdminTestJSON-1661596657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3e78b0b9-3d28-469d-8d86-acae9e3485f9 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:40 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3e78b0b9-3d28-469d-8d86-acae9e3485f9 Nov 02 15:38:40 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:40 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f3e7c70b-d201-4d7f-817e-d71914115ee7 tempest-VolumesListAdminTestJSON-1661596657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3e78b0b9-3d28-469d-8d86-acae9e3485f9" returned: 0 in 0.335s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f3e7c70b-d201-4d7f-817e-d71914115ee7 tempest-VolumesListAdminTestJSON-1661596657 None] Lock "cinder-quobyte-3e78b0b9-3d28-469d-8d86-acae9e3485f9" released by "delete_volume" :: held 0.878s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:38:40 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-f3e7c70b-d201-4d7f-817e-d71914115ee7 tempest-VolumesListAdminTestJSON-1661596657 None] Created reservations ['2691710b-0020-4a7c-aba4-cb42d87816f1', 'dcc5c748-3b1b-41fc-a04c-1bc39f9b6e7f', '0ecfdf55-ca12-41cf-8f92-bacd3eb8fc0e', '8495da69-ac1b-41cb-b3d1-fd8a2526bc76'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:38:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f3e7c70b-d201-4d7f-817e-d71914115ee7 tempest-VolumesListAdminTestJSON-1661596657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f3e7c70b-d201-4d7f-817e-d71914115ee7 tempest-VolumesListAdminTestJSON-1661596657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:40 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f3e7c70b-d201-4d7f-817e-d71914115ee7 tempest-VolumesListAdminTestJSON-1661596657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:38:40 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f3e7c70b-d201-4d7f-817e-d71914115ee7 tempest-VolumesListAdminTestJSON-1661596657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:38:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f3e7c70b-d201-4d7f-817e-d71914115ee7 tempest-VolumesListAdminTestJSON-1661596657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f3e7c70b-d201-4d7f-817e-d71914115ee7 tempest-VolumesListAdminTestJSON-1661596657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:40 devstack sudo[98668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:38:40 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-26305449-c73a-4c6c-9661-d647ef943cb6 tempest-VolumesListAdminTestJSON-1661596657 None] Acquiring lock "cinder-1bb3b5b0-cf51-4f2a-8193-26dae99e22fb-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:38:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-26305449-c73a-4c6c-9661-d647ef943cb6 tempest-VolumesListAdminTestJSON-1661596657 None] Lock "cinder-1bb3b5b0-cf51-4f2a-8193-26dae99e22fb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:38:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-26305449-c73a-4c6c-9661-d647ef943cb6 tempest-VolumesListAdminTestJSON-1661596657 None] Acquiring lock "cinder-quobyte-1bb3b5b0-cf51-4f2a-8193-26dae99e22fb" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:38:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-26305449-c73a-4c6c-9661-d647ef943cb6 tempest-VolumesListAdminTestJSON-1661596657 None] Lock "cinder-quobyte-1bb3b5b0-cf51-4f2a-8193-26dae99e22fb" acquired by "delete_volume" :: waited 0.031s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:38:40 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a36f0ed-ace1-4024-be02-de6e9641e8c6]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:38:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-26305449-c73a-4c6c-9661-d647ef943cb6 tempest-VolumesListAdminTestJSON-1661596657 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1bb3b5b0-cf51-4f2a-8193-26dae99e22fb {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:41 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f3e7c70b-d201-4d7f-817e-d71914115ee7 tempest-VolumesListAdminTestJSON-1661596657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.400s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:41 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-f3e7c70b-d201-4d7f-817e-d71914115ee7 tempest-VolumesListAdminTestJSON-1661596657 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:38:41 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-f3e7c70b-d201-4d7f-817e-d71914115ee7 tempest-VolumesListAdminTestJSON-1661596657 None] Deleted volume successfully. Nov 02 15:38:41 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f3e7c70b-d201-4d7f-817e-d71914115ee7 tempest-VolumesListAdminTestJSON-1661596657 None] Lock "cinder-3e78b0b9-3d28-469d-8d86-acae9e3485f9-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:38:41 devstack sudo[98670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1bb3b5b0-cf51-4f2a-8193-26dae99e22fb Nov 02 15:38:41 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:41 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-26305449-c73a-4c6c-9661-d647ef943cb6 tempest-VolumesListAdminTestJSON-1661596657 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1bb3b5b0-cf51-4f2a-8193-26dae99e22fb" returned: 0 in 0.446s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-26305449-c73a-4c6c-9661-d647ef943cb6 tempest-VolumesListAdminTestJSON-1661596657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1bb3b5b0-cf51-4f2a-8193-26dae99e22fb {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:41 devstack sudo[98681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1bb3b5b0-cf51-4f2a-8193-26dae99e22fb Nov 02 15:38:41 devstack sudo[98681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:41 devstack sudo[98681]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-26305449-c73a-4c6c-9661-d647ef943cb6 tempest-VolumesListAdminTestJSON-1661596657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1bb3b5b0-cf51-4f2a-8193-26dae99e22fb" returned: 0 in 0.386s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:41 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-26305449-c73a-4c6c-9661-d647ef943cb6 tempest-VolumesListAdminTestJSON-1661596657 None] Lock "cinder-quobyte-1bb3b5b0-cf51-4f2a-8193-26dae99e22fb" released by "delete_volume" :: held 0.896s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:38:41 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-26305449-c73a-4c6c-9661-d647ef943cb6 tempest-VolumesListAdminTestJSON-1661596657 None] Created reservations ['04d435ab-03d8-4854-bd88-09c2599d436e', '86f414ab-c5a7-4c6a-9a8b-3a8bede1320c', 'ffbe2619-aa78-4fe2-84ea-b5b74fe5826c', 'd251d424-c258-44f5-8be1-077b22b3a243'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:38:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-26305449-c73a-4c6c-9661-d647ef943cb6 tempest-VolumesListAdminTestJSON-1661596657 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-26305449-c73a-4c6c-9661-d647ef943cb6 tempest-VolumesListAdminTestJSON-1661596657 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:41 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-26305449-c73a-4c6c-9661-d647ef943cb6 tempest-VolumesListAdminTestJSON-1661596657 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:38:41 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-26305449-c73a-4c6c-9661-d647ef943cb6 tempest-VolumesListAdminTestJSON-1661596657 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:38:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-26305449-c73a-4c6c-9661-d647ef943cb6 tempest-VolumesListAdminTestJSON-1661596657 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-26305449-c73a-4c6c-9661-d647ef943cb6 tempest-VolumesListAdminTestJSON-1661596657 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:41 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:38:41 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:42 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-26305449-c73a-4c6c-9661-d647ef943cb6 tempest-VolumesListAdminTestJSON-1661596657 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.354s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:42 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-26305449-c73a-4c6c-9661-d647ef943cb6 tempest-VolumesListAdminTestJSON-1661596657 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:38:42 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-26305449-c73a-4c6c-9661-d647ef943cb6 tempest-VolumesListAdminTestJSON-1661596657 None] Deleted volume successfully. Nov 02 15:38:42 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-26305449-c73a-4c6c-9661-d647ef943cb6 tempest-VolumesListAdminTestJSON-1661596657 None] Lock "cinder-1bb3b5b0-cf51-4f2a-8193-26dae99e22fb-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:38:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-b476f7cf-6c97-4c2a-a7fd-de306ff665aa req-787cb4fe-4117-4f7b-8fef-c10bdbc4e9ae tempest-TestStampPattern-141219102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-b476f7cf-6c97-4c2a-a7fd-de306ff665aa req-787cb4fe-4117-4f7b-8fef-c10bdbc4e9ae tempest-TestStampPattern-141219102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-b476f7cf-6c97-4c2a-a7fd-de306ff665aa req-787cb4fe-4117-4f7b-8fef-c10bdbc4e9ae tempest-TestStampPattern-141219102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:42 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-b476f7cf-6c97-4c2a-a7fd-de306ff665aa req-787cb4fe-4117-4f7b-8fef-c10bdbc4e9ae tempest-TestStampPattern-141219102 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478', 'name': 'volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '37740f85-7fe0-4f80-9e57-80aa5d0bce40', 'enforce_multipath': True} {{(pid=86703) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 15:38:43 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-b476f7cf-6c97-4c2a-a7fd-de306ff665aa req-787cb4fe-4117-4f7b-8fef-c10bdbc4e9ae tempest-TestStampPattern-141219102 None] attachment_update completed successfully. Nov 02 15:38:47 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-1c1f2cdc-be15-46a4-9e6a-214c8b9dfa48 tempest-GroupSnapshotsTest-2041888239 None] Group tempest-GroupSnapshotsTest-Group-49455784: creating Nov 02 15:38:47 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-1c1f2cdc-be15-46a4-9e6a-214c8b9dfa48 tempest-GroupSnapshotsTest-2041888239 None] Group tempest-GroupSnapshotsTest-Group-49455784: created successfully Nov 02 15:38:47 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-1c1f2cdc-be15-46a4-9e6a-214c8b9dfa48 tempest-GroupSnapshotsTest-2041888239 None] Create group completed successfully. Nov 02 15:38:49 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:38:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] Flow 'volume_create_manager' (5226f1a1-c1fb-45a1-bff4-cb5c6af1cb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:38:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9a27aae-df26-4197-bdfb-a73d8ba5e801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9a27aae-df26-4197-bdfb-a73d8ba5e801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1101519517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6d7b5b24-ffdb-427d-835a-13519aca076d,host='devstack@QuobyteHD#QuobyteHD',id=bf775072-dc17-4bdf-a2fd-189e713b45d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad9598ccb614ffea3d47292cc4aa60d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:38:49Z,use_quota=True,user_id='73ff6941c0b043a392e5b56e97b46f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8853048b-a6ad-4184-a64b-f48b21d17c8d),volume_type_id=8853048b-a6ad-4184-a64b-f48b21d17c8d)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8ff80c6-d8ce-4ee5-9ddf-9fefee920ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8ff80c6-d8ce-4ee5-9ddf-9fefee920ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe9cca25-b59e-4dfd-a979-bb6c6a914218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe9cca25-b59e-4dfd-a979-bb6c6a914218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf775072-dc17-4bdf-a2fd-189e713b45d6', 'volume_name': 'volume-bf775072-dc17-4bdf-a2fd-189e713b45d6', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d945e70a-d0ee-4fdc-958e-514ca041afab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d945e70a-d0ee-4fdc-958e-514ca041afab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ffdb6f5-eae9-4b7f-9a9c-1f47ffdd05c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:49 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] Volume bf775072-dc17-4bdf-a2fd-189e713b45d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf775072-dc17-4bdf-a2fd-189e713b45d6', 'volume_size': 1} Nov 02 15:38:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6d7b5b24-ffdb-427d-835a-13519aca076d,created_at=2026-11-02T14:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1101519517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6d7b5b24-ffdb-427d-835a-13519aca076d,host='devstack@QuobyteHD#QuobyteHD',id=bf775072-dc17-4bdf-a2fd-189e713b45d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad9598ccb614ffea3d47292cc4aa60d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:38:49Z,use_quota=True,user_id='73ff6941c0b043a392e5b56e97b46f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8853048b-a6ad-4184-a64b-f48b21d17c8d),volume_type_id=8853048b-a6ad-4184-a64b-f48b21d17c8d)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:38:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] Creating volume bf775072-dc17-4bdf-a2fd-189e713b45d6 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:38:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:38:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:38:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:38:49 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:38:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:49 devstack sudo[99136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6 1073741824 Nov 02 15:38:49 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:49 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-39c83e51-01aa-456a-9e59-2f2bcd5916b6 req-00fdea2c-ed81-42c9-8404-eb4aa58e64a7 tempest-TestStampPattern-141219102 None] Terminate volume connection completed successfully. Nov 02 15:38:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-39c83e51-01aa-456a-9e59-2f2bcd5916b6 req-00fdea2c-ed81-42c9-8404-eb4aa58e64a7 tempest-TestStampPattern-141219102 None] Deleting attachment 37740f85-7fe0-4f80-9e57-80aa5d0bce40. {{(pid=86703) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 15:38:49 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:38:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Flow 'volume_create_manager' (cca54e02-365c-41ee-8537-2ff1b00629f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:38:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efe2ada2-c5da-404a-92c0-1fee5a7bfaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efe2ada2-c5da-404a-92c0-1fee5a7bfaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-9003263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=923cf4b2-af7d-4fc1-a3c4-058d2a439540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc9ca513691486fbc7771a5597f526c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:38:50Z,use_quota=True,user_id='253a0dac66fc4e219add6c22105cf5ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797a41cc-5a31-470f-84e5-fad545d4634a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:50 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797a41cc-5a31-470f-84e5-fad545d4634a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a87fc58f-63f2-4ebc-9efb-405508d6b44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:50 devstack cinder-volume[86703]: DEBUG cinder.image.glance [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Creating Keystone auth plugin from conf {{(pid=86703) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 15:38:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6 1073741824" returned: 0 in 0.702s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:50 devstack sudo[99169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6 Nov 02 15:38:50 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:50 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6" returned: 0 in 0.362s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:50 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:38:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ffdb6f5-eae9-4b7f-9a9c-1f47ffdd05c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf775072-dc17-4bdf-a2fd-189e713b45d6', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ad108ab-7e14-4e54-88a2-fa16c722f658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:50 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] Volume volume-bf775072-dc17-4bdf-a2fd-189e713b45d6 (bf775072-dc17-4bdf-a2fd-189e713b45d6): created successfully Nov 02 15:38:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ad108ab-7e14-4e54-88a2-fa16c722f658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] Flow 'volume_create_manager' (5226f1a1-c1fb-45a1-bff4-cb5c6af1cb61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:38:50 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-05165b53-3165-48e0-838a-e8f8200eb1ca tempest-GroupSnapshotsTest-2041888239 None] Created volume successfully. Nov 02 15:38:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9e491e66-5fd3-4933-985f-414934bf91be tempest-TestStampPattern-141219102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9e491e66-5fd3-4933-985f-414934bf91be tempest-TestStampPattern-141219102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:50 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-9e491e66-5fd3-4933-985f-414934bf91be tempest-TestStampPattern-141219102 None] Creating offline snapshot 4730852c-85d0-4a1c-9c53-fb9f37fcf6ec of volume b17e6e9c-10ab-4ba0-b20d-1224d031c3c8 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:38:50 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fbac30-0055-4337-83d9-9c668cab4469]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:38:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9e491e66-5fd3-4933-985f-414934bf91be tempest-TestStampPattern-141219102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a87fc58f-63f2-4ebc-9efb-405508d6b44b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '923cf4b2-af7d-4fc1-a3c4-058d2a439540', 'volume_name': 'volume-923cf4b2-af7d-4fc1-a3c4-058d2a439540', 'volume_size': 1, 'image_id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '583ef2b19215459298db002053800c52', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'created_at': datetime.datetime(2026, 11, 2, 14, 23, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 14, 23, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb8e103-1f7c-497f-aac0-214208fd438e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb8e103-1f7c-497f-aac0-214208fd438e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:38:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (635d9f9b-e761-47c0-8c33-96509fac976f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:38:50 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Volume 923cf4b2-af7d-4fc1-a3c4-058d2a439540: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-923cf4b2-af7d-4fc1-a3c4-058d2a439540', 'volume_size': 1, 'image_id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '583ef2b19215459298db002053800c52', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'created_at': datetime.datetime(2026, 11, 2, 14, 23, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 14, 23, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 15:38:50 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Trying to clone 923cf4b2-af7d-4fc1-a3c4-058d2a439540 from image 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 at location (None, [{'url': 'file:///opt/stack/data/glance/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'metadata': {}}]). {{(pid=86703) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 15:38:50 devstack sudo[99172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8 Nov 02 15:38:50 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:51 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_u5qkop_vdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86703) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 15:38:51 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Image download 20.69 MB at 20.69 MB/s Nov 02 15:38:51 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[aece28e8-ea51-4ffa-a842-f04ffbf87c73]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:38:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_u5qkop_vdevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:51 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9e491e66-5fd3-4933-985f-414934bf91be tempest-TestStampPattern-141219102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8" returned: 0 in 0.543s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9e491e66-5fd3-4933-985f-414934bf91be tempest-TestStampPattern-141219102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8.4730852c-85d0-4a1c-9c53-fb9f37fcf6ec 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:51 devstack sudo[99179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8.4730852c-85d0-4a1c-9c53-fb9f37fcf6ec 1G Nov 02 15:38:51 devstack sudo[99179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:51 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_u5qkop_vdevstack@QuobyteHD Nov 02 15:38:51 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:51 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_u5qkop_vdevstack@QuobyteHD" returned: 0 in 0.431s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:51 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Temporary image 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 is fetched for user 253a0dac66fc4e219add6c22105cf5ff. {{(pid=86703) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 15:38:51 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d133887-b648-4fb0-aebc-5c638f07dd6f]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:38:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_u5qkop_vdevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:51 devstack sudo[99179]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9e491e66-5fd3-4933-985f-414934bf91be tempest-TestStampPattern-141219102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8.4730852c-85d0-4a1c-9c53-fb9f37fcf6ec 1G" returned: 0 in 0.564s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9e491e66-5fd3-4933-985f-414934bf91be tempest-TestStampPattern-141219102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8.4730852c-85d0-4a1c-9c53-fb9f37fcf6ec {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:51 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8.4730852c-85d0-4a1c-9c53-fb9f37fcf6ec Nov 02 15:38:51 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:51 devstack sudo[99188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_u5qkop_vdevstack@QuobyteHD Nov 02 15:38:51 devstack sudo[99188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:52 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-823b4ad1-0e68-4054-9bc7-bb49eae81581 tempest-GroupSnapshotsTest-2041888239 None] GroupSnapshot 48f6102b-08cb-4471-954a-d4fe9ad53487: creating. Nov 02 15:38:52 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-823b4ad1-0e68-4054-9bc7-bb49eae81581 tempest-GroupSnapshotsTest-2041888239 None] Group snapshot 48f6102b-08cb-4471-954a-d4fe9ad53487: creating. {{(pid=86703) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 15:38:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-823b4ad1-0e68-4054-9bc7-bb49eae81581 tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:52 devstack sudo[99188]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_u5qkop_vdevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:52 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9e491e66-5fd3-4933-985f-414934bf91be tempest-TestStampPattern-141219102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8.4730852c-85d0-4a1c-9c53-fb9f37fcf6ec" returned: 0 in 0.425s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:52 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-9e491e66-5fd3-4933-985f-414934bf91be tempest-TestStampPattern-141219102 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8.4730852c-85d0-4a1c-9c53-fb9f37fcf6ec is being set with open permissions: ugo+rw Nov 02 15:38:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9e491e66-5fd3-4933-985f-414934bf91be tempest-TestStampPattern-141219102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8.4730852c-85d0-4a1c-9c53-fb9f37fcf6ec {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:52 devstack sudo[99198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8.4730852c-85d0-4a1c-9c53-fb9f37fcf6ec Nov 02 15:38:52 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:52 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9e491e66-5fd3-4933-985f-414934bf91be tempest-TestStampPattern-141219102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8.4730852c-85d0-4a1c-9c53-fb9f37fcf6ec" returned: 0 in 0.244s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9e491e66-5fd3-4933-985f-414934bf91be tempest-TestStampPattern-141219102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:52 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8.info Nov 02 15:38:52 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:52 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9e491e66-5fd3-4933-985f-414934bf91be tempest-TestStampPattern-141219102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8.info" returned: 0 in 0.281s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:52 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-9e491e66-5fd3-4933-985f-414934bf91be tempest-TestStampPattern-141219102 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8.info is being set with open permissions: ugo+rw Nov 02 15:38:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9e491e66-5fd3-4933-985f-414934bf91be tempest-TestStampPattern-141219102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:52 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8.info Nov 02 15:38:52 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:53 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9e491e66-5fd3-4933-985f-414934bf91be tempest-TestStampPattern-141219102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8.info" returned: 0 in 0.261s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9e491e66-5fd3-4933-985f-414934bf91be tempest-TestStampPattern-141219102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.425s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-823b4ad1-0e68-4054-9bc7-bb49eae81581 tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.079s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:53 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-823b4ad1-0e68-4054-9bc7-bb49eae81581 tempest-GroupSnapshotsTest-2041888239 None] Creating offline snapshot b07695a0-76d6-40ca-ada9-edeafd5b690f of volume bf775072-dc17-4bdf-a2fd-189e713b45d6 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:38:53 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-9e491e66-5fd3-4933-985f-414934bf91be tempest-TestStampPattern-141219102 None] Create snapshot completed successfully Nov 02 15:38:53 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[044210c2-b550-4a12-b2dd-8e73aa6ce765]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:38:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-823b4ad1-0e68-4054-9bc7-bb49eae81581 tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:53 devstack sudo[99207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6 Nov 02 15:38:53 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:53 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-823b4ad1-0e68-4054-9bc7-bb49eae81581 tempest-GroupSnapshotsTest-2041888239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6" returned: 0 in 0.377s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-823b4ad1-0e68-4054-9bc7-bb49eae81581 tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6.b07695a0-76d6-40ca-ada9-edeafd5b690f 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:53 devstack sudo[99246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6.b07695a0-76d6-40ca-ada9-edeafd5b690f 1G Nov 02 15:38:53 devstack sudo[99246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:54 devstack sudo[99246]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-823b4ad1-0e68-4054-9bc7-bb49eae81581 tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6.b07695a0-76d6-40ca-ada9-edeafd5b690f 1G" returned: 0 in 0.525s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-823b4ad1-0e68-4054-9bc7-bb49eae81581 tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf775072-dc17-4bdf-a2fd-189e713b45d6 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6.b07695a0-76d6-40ca-ada9-edeafd5b690f {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:54 devstack sudo[99254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf775072-dc17-4bdf-a2fd-189e713b45d6 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6.b07695a0-76d6-40ca-ada9-edeafd5b690f Nov 02 15:38:54 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:54 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-823b4ad1-0e68-4054-9bc7-bb49eae81581 tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf775072-dc17-4bdf-a2fd-189e713b45d6 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6.b07695a0-76d6-40ca-ada9-edeafd5b690f" returned: 0 in 0.340s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:54 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-823b4ad1-0e68-4054-9bc7-bb49eae81581 tempest-GroupSnapshotsTest-2041888239 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6.b07695a0-76d6-40ca-ada9-edeafd5b690f is being set with open permissions: ugo+rw: NotImplementedError Nov 02 15:38:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-823b4ad1-0e68-4054-9bc7-bb49eae81581 tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6.b07695a0-76d6-40ca-ada9-edeafd5b690f {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:54 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6.b07695a0-76d6-40ca-ada9-edeafd5b690f Nov 02 15:38:54 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:54 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-823b4ad1-0e68-4054-9bc7-bb49eae81581 tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6.b07695a0-76d6-40ca-ada9-edeafd5b690f" returned: 0 in 0.290s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-823b4ad1-0e68-4054-9bc7-bb49eae81581 tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:54 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6.info Nov 02 15:38:54 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:55 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-823b4ad1-0e68-4054-9bc7-bb49eae81581 tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6.info" returned: 0 in 0.322s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:55 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-823b4ad1-0e68-4054-9bc7-bb49eae81581 tempest-GroupSnapshotsTest-2041888239 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 15:38:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-823b4ad1-0e68-4054-9bc7-bb49eae81581 tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:55 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6.info Nov 02 15:38:55 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:55 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-823b4ad1-0e68-4054-9bc7-bb49eae81581 tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6.info" returned: 0 in 0.275s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-823b4ad1-0e68-4054-9bc7-bb49eae81581 tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.248s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.177s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:55 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-9003263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=923cf4b2-af7d-4fc1-a3c4-058d2a439540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebc9ca513691486fbc7771a5597f526c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:38:50Z,use_quota=True,user_id='253a0dac66fc4e219add6c22105cf5ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:38:55 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Creating volume 923cf4b2-af7d-4fc1-a3c4-058d2a439540 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:38:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:55 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:38:55 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:38:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:55 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:38:55 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:38:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-923cf4b2-af7d-4fc1-a3c4-058d2a439540 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:55 devstack sudo[99268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-923cf4b2-af7d-4fc1-a3c4-058d2a439540 1073741824 Nov 02 15:38:55 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:55 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-823b4ad1-0e68-4054-9bc7-bb49eae81581 tempest-GroupSnapshotsTest-2041888239 None] group_snapshot 48f6102b-08cb-4471-954a-d4fe9ad53487: created successfully Nov 02 15:38:55 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-923cf4b2-af7d-4fc1-a3c4-058d2a439540 1073741824" returned: 0 in 0.517s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-923cf4b2-af7d-4fc1-a3c4-058d2a439540 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:56 devstack sudo[99292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-923cf4b2-af7d-4fc1-a3c4-058d2a439540 Nov 02 15:38:56 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:56 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-923cf4b2-af7d-4fc1-a3c4-058d2a439540" returned: 0 in 0.318s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:56 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:38:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:56 devstack cinder-volume[86703]: DEBUG cinder.volume.volume_utils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Attempting download of 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 ((None, [{'url': 'file:///opt/stack/data/glance/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'metadata': {}}])) to volume 923cf4b2-af7d-4fc1-a3c4-058d2a439540. {{(pid=86703) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 15:38:56 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73ecc35-0173-43e2-9adc-b311000d05f8]: (4, 'raw') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:38:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_lxnx8e7l {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:56 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_lxnx8e7l Nov 02 15:38:56 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:56 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_lxnx8e7l" returned: 0 in 0.378s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_lxnx8e7l {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:57 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_lxnx8e7l Nov 02 15:38:57 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:57 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_lxnx8e7l" returned: 1 in 0.465s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_lxnx8e7l' failed. Not Retrying. {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 15:38:57 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4144927-55f3-4640-b023-16193dc72434]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:38:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_u5qkop_vdevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:57 devstack sudo[99313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_u5qkop_vdevstack@QuobyteHD Nov 02 15:38:57 devstack sudo[99313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:57 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "cinder-quobyte-b07695a0-76d6-40ca-ada9-edeafd5b690f-0c919ef0-65a6-4c2f-a04a-ce631870d3f7" by "_create_volume_from_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:38:57 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] Lock "cinder-quobyte-b07695a0-76d6-40ca-ada9-edeafd5b690f-0c919ef0-65a6-4c2f-a04a-ce631870d3f7" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:38:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] Creating volume 0c919ef0-65a6-4c2f-a04a-ce631870d3f7 from snapshot b07695a0-76d6-40ca-ada9-edeafd5b690f {{(pid=86703) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 15:38:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:38:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:38:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:38:57 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "cinder-quobyte-0c919ef0-65a6-4c2f-a04a-ce631870d3f7" by "_copy_volume_from_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:38:57 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] Lock "cinder-quobyte-0c919ef0-65a6-4c2f-a04a-ce631870d3f7" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:38:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] snapshot: b07695a0-76d6-40ca-ada9-edeafd5b690f, volume: 0c919ef0-65a6-4c2f-a04a-ce631870d3f7, {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 15:38:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:38:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:38:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:38:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:38:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:38:57 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c0dba8-88c9-4e7b-95af-263c9913f517]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:38:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6.b07695a0-76d6-40ca-ada9-edeafd5b690f {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:57 devstack sudo[99315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6.b07695a0-76d6-40ca-ada9-edeafd5b690f Nov 02 15:38:57 devstack sudo[99315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:57 devstack sudo[99313]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_u5qkop_vdevstack@QuobyteHD" returned: 0 in 0.618s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:57 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 was qcow2, converting to qcow2 {{(pid=86703) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 15:38:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_u5qkop_vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-923cf4b2-af7d-4fc1-a3c4-058d2a439540 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:58 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_u5qkop_vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-923cf4b2-af7d-4fc1-a3c4-058d2a439540 Nov 02 15:38:58 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:58 devstack sudo[99315]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6.b07695a0-76d6-40ca-ada9-edeafd5b690f" returned: 0 in 0.529s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:58 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf775072-dc17-4bdf-a2fd-189e713b45d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:38:58 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78cb718-1089-4b67-b224-56cff5857990]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:38:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:58 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6 Nov 02 15:38:58 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:38:58 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Nov 02 15:38:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6" returned: 0 in 0.491s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:38:58 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] will copy from snapshot at /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6 {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 15:38:58 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] Creating direct copy from snapshot {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 15:38:58 devstack cinder-volume[86703]: DEBUG cinder.utils [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] Path /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0c919ef0-65a6-4c2f-a04a-ce631870d3f7 not found in is_blk_device check {{(pid=86703) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 15:38:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0c919ef0-65a6-4c2f-a04a-ce631870d3f7 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:38:58 devstack sudo[99339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0c919ef0-65a6-4c2f-a04a-ce631870d3f7 Nov 02 15:38:58 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:02 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_u5qkop_vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-923cf4b2-af7d-4fc1-a3c4-058d2a439540" returned: 0 in 4.342s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:02 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_u5qkop_vdevstack@QuobyteHD, size 112.00 MB, duration 4.35 sec, destination /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-923cf4b2-af7d-4fc1-a3c4-058d2a439540 {{(pid=86703) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 15:39:02 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Converted 112.00 MB image at 25.77 MB/s Nov 02 15:39:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-923cf4b2-af7d-4fc1-a3c4-058d2a439540 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:02 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-923cf4b2-af7d-4fc1-a3c4-058d2a439540 1G Nov 02 15:39:02 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:03 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-923cf4b2-af7d-4fc1-a3c4-058d2a439540 1G" returned: 0 in 0.941s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:03 devstack cinder-volume[86703]: DEBUG cinder.volume.volume_utils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Downloaded image 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 ((None, [{'url': 'file:///opt/stack/data/glance/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'metadata': {}}])) to volume 923cf4b2-af7d-4fc1-a3c4-058d2a439540 successfully. {{(pid=86703) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 15:39:03 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Temporary image 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 for user 253a0dac66fc4e219add6c22105cf5ff is deleted. {{(pid=86703) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 15:39:03 devstack cinder-volume[86703]: DEBUG cinder.volume.volume_utils [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Marking volume 923cf4b2-af7d-4fc1-a3c4-058d2a439540 as bootable. {{(pid=86703) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 15:39:03 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Copying metadata from image 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 to 923cf4b2-af7d-4fc1-a3c4-058d2a439540. {{(pid=86703) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 15:39:03 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Creating volume glance metadata for volume 923cf4b2-af7d-4fc1-a3c4-058d2a439540 backed by image 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86703) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 15:39:03 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (635d9f9b-e761-47c0-8c33-96509fac976f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-923cf4b2-af7d-4fc1-a3c4-058d2a439540', 'volume_size': 1, 'image_id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '583ef2b19215459298db002053800c52', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'created_at': datetime.datetime(2026, 11, 2, 14, 23, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 14, 23, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:03 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14fbaee9-4f87-4b94-9ca6-9ca181bcfb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:03 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Volume volume-923cf4b2-af7d-4fc1-a3c4-058d2a439540 (923cf4b2-af7d-4fc1-a3c4-058d2a439540): created successfully Nov 02 15:39:03 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14fbaee9-4f87-4b94-9ca6-9ca181bcfb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:03 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Flow 'volume_create_manager' (cca54e02-365c-41ee-8537-2ff1b00629f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:39:03 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-e88fb518-400a-4352-8b2c-482240b90d7a tempest-VolumesImageMetadata-514624214 None] Created volume successfully. Nov 02 15:39:03 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:39:03 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Flow 'volume_create_manager' (3c6eb4ad-62c4-49b3-9398-9869b9f3ad6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:39:04 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b86e269-3ea5-4340-9536-7342208dce79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:04 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b86e269-3ea5-4340-9536-7342208dce79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:39:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2027369220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ea481b8-1e1d-4d7c-aebe-47ce449c4544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ada10bbb07574638abedaca82f5198a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:39:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4730852c-85d0-4a1c-9c53-fb9f37fcf6ec,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:39:04Z,use_quota=True,user_id='aade2713999a4853aa8c307b288c394f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:04 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa0233b8-9af7-42e7-b6e0-1fe92d2cee21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:04 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa0233b8-9af7-42e7-b6e0-1fe92d2cee21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:04 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (975424b6-fdbd-4924-b106-761f1f79cdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:04 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (975424b6-fdbd-4924-b106-761f1f79cdf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9ea481b8-1e1d-4d7c-aebe-47ce449c4544', 'volume_name': 'volume-9ea481b8-1e1d-4d7c-aebe-47ce449c4544', 'volume_size': 1, 'snapshot_id': '4730852c-85d0-4a1c-9c53-fb9f37fcf6ec'}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:04 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99c4ff1d-f7e3-4423-a69b-2c0014a736b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:04 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99c4ff1d-f7e3-4423-a69b-2c0014a736b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:04 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f20ec7a-2e33-46f8-a405-0dc1727a9e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:04 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Volume 9ea481b8-1e1d-4d7c-aebe-47ce449c4544: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9ea481b8-1e1d-4d7c-aebe-47ce449c4544', 'volume_size': 1, 'snapshot_id': '4730852c-85d0-4a1c-9c53-fb9f37fcf6ec'} Nov 02 15:39:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:05 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:39:05 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Flow 'volume_create_manager' (bba34150-bf6a-45f4-b19f-ee4da3586b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:39:05 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b3e098-b61e-4c00-852d-bf703575bd35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:05 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-9ed18012-12b9-4986-89a1-f21b0d8b216e tempest-VolumesImageMetadata-514624214 None] Acquiring lock "cinder-923cf4b2-af7d-4fc1-a3c4-058d2a439540-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:39:05 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7b3e098-b61e-4c00-852d-bf703575bd35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1205213657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1e9a88-d218-4b23-a612-31a97f684cd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c2160dba0ca421690bf8de1d9331d0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:39:05Z,use_quota=True,user_id='9a29873b617a4b4a98e28a3b2632ebf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae39ca0-c95b-4f7e-a414-53c7490898ff),volume_type_id=6ae39ca0-c95b-4f7e-a414-53c7490898ff)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:05 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (594a8662-d22f-4348-b290-e67e5cdb4bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:05 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (594a8662-d22f-4348-b290-e67e5cdb4bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:05 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af166472-af41-48b9-a141-031b6dabaf29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:05 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af166472-af41-48b9-a141-031b6dabaf29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e1e9a88-d218-4b23-a612-31a97f684cd5', 'volume_name': 'volume-4e1e9a88-d218-4b23-a612-31a97f684cd5', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:05 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11172ce5-c12c-4ec1-8846-2051da193216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:05 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11172ce5-c12c-4ec1-8846-2051da193216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:05 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321c31bb-d51f-4f88-9c61-39f79a8dc3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:05 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Volume 4e1e9a88-d218-4b23-a612-31a97f684cd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e1e9a88-d218-4b23-a612-31a97f684cd5', 'volume_size': 1} Nov 02 15:39:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:05 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-9ed18012-12b9-4986-89a1-f21b0d8b216e tempest-VolumesImageMetadata-514624214 None] Lock "cinder-923cf4b2-af7d-4fc1-a3c4-058d2a439540-delete_volume" acquired by "delete_volume" :: waited 0.223s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:39:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-9ed18012-12b9-4986-89a1-f21b0d8b216e tempest-VolumesImageMetadata-514624214 None] Acquiring lock "cinder-quobyte-923cf4b2-af7d-4fc1-a3c4-058d2a439540" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:39:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-9ed18012-12b9-4986-89a1-f21b0d8b216e tempest-VolumesImageMetadata-514624214 None] Lock "cinder-quobyte-923cf4b2-af7d-4fc1-a3c4-058d2a439540" acquired by "delete_volume" :: waited 0.034s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:39:06 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca1300e-8847-44b2-83fa-24e6dfff4520]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:39:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9ed18012-12b9-4986-89a1-f21b0d8b216e tempest-VolumesImageMetadata-514624214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-923cf4b2-af7d-4fc1-a3c4-058d2a439540 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:06 devstack sudo[99368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-923cf4b2-af7d-4fc1-a3c4-058d2a439540 Nov 02 15:39:06 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:06 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9ed18012-12b9-4986-89a1-f21b0d8b216e tempest-VolumesImageMetadata-514624214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-923cf4b2-af7d-4fc1-a3c4-058d2a439540" returned: 0 in 0.745s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9ed18012-12b9-4986-89a1-f21b0d8b216e tempest-VolumesImageMetadata-514624214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-923cf4b2-af7d-4fc1-a3c4-058d2a439540 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:06 devstack sudo[99373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-923cf4b2-af7d-4fc1-a3c4-058d2a439540 Nov 02 15:39:06 devstack sudo[99373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:07 devstack sudo[99373]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9ed18012-12b9-4986-89a1-f21b0d8b216e tempest-VolumesImageMetadata-514624214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-923cf4b2-af7d-4fc1-a3c4-058d2a439540" returned: 0 in 0.664s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:07 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-9ed18012-12b9-4986-89a1-f21b0d8b216e tempest-VolumesImageMetadata-514624214 None] Lock "cinder-quobyte-923cf4b2-af7d-4fc1-a3c4-058d2a439540" released by "delete_volume" :: held 1.521s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:39:07 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-9ed18012-12b9-4986-89a1-f21b0d8b216e tempest-VolumesImageMetadata-514624214 None] Created reservations ['356138fa-4646-4dec-b18f-d1bedb5282db', '921f0239-c6b8-4e3a-9dce-b710baf2feb6', '66ba061e-4876-4574-ba45-37289239db6d', 'dcf00fa1-40cd-465a-a378-ae739ef4bc66'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:39:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9ed18012-12b9-4986-89a1-f21b0d8b216e tempest-VolumesImageMetadata-514624214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9ed18012-12b9-4986-89a1-f21b0d8b216e tempest-VolumesImageMetadata-514624214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:07 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9ed18012-12b9-4986-89a1-f21b0d8b216e tempest-VolumesImageMetadata-514624214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:39:07 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9ed18012-12b9-4986-89a1-f21b0d8b216e tempest-VolumesImageMetadata-514624214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:39:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9ed18012-12b9-4986-89a1-f21b0d8b216e tempest-VolumesImageMetadata-514624214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9ed18012-12b9-4986-89a1-f21b0d8b216e tempest-VolumesImageMetadata-514624214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:07 devstack sudo[99376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:39:07 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:08 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0c919ef0-65a6-4c2f-a04a-ce631870d3f7" returned: 0 in 9.476s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:08 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] Image conversion details: src /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6, size 1024.00 MB, duration 9.48 sec, destination /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0c919ef0-65a6-4c2f-a04a-ce631870d3f7 {{(pid=86703) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 15:39:08 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] Converted 1024.00 MB image at 108.01 MB/s Nov 02 15:39:08 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0c919ef0-65a6-4c2f-a04a-ce631870d3f7 is being set with open permissions: ugo+rw: NotImplementedError Nov 02 15:39:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0c919ef0-65a6-4c2f-a04a-ce631870d3f7 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:08 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9ed18012-12b9-4986-89a1-f21b0d8b216e tempest-VolumesImageMetadata-514624214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.460s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:08 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-9ed18012-12b9-4986-89a1-f21b0d8b216e tempest-VolumesImageMetadata-514624214 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:39:08 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-9ed18012-12b9-4986-89a1-f21b0d8b216e tempest-VolumesImageMetadata-514624214 None] Deleted volume successfully. Nov 02 15:39:08 devstack sudo[99379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0c919ef0-65a6-4c2f-a04a-ce631870d3f7 Nov 02 15:39:08 devstack sudo[99379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:08 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-9ed18012-12b9-4986-89a1-f21b0d8b216e tempest-VolumesImageMetadata-514624214 None] Lock "cinder-923cf4b2-af7d-4fc1-a3c4-058d2a439540-delete_volume" released by "delete_volume" :: held 2.419s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:39:08 devstack sudo[99379]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0c919ef0-65a6-4c2f-a04a-ce631870d3f7" returned: 0 in 0.345s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:08 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] Lock "cinder-quobyte-0c919ef0-65a6-4c2f-a04a-ce631870d3f7" released by "_copy_volume_from_snapshot" :: held 11.010s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:39:08 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] Lock "cinder-quobyte-b07695a0-76d6-40ca-ada9-edeafd5b690f-0c919ef0-65a6-4c2f-a04a-ce631870d3f7" released by "_create_volume_from_snapshot" :: held 11.119s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:39:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.151s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.539s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:08 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Acquiring lock "cinder-quobyte-4730852c-85d0-4a1c-9c53-fb9f37fcf6ec-9ea481b8-1e1d-4d7c-aebe-47ce449c4544" by "_create_volume_from_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:39:08 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Lock "cinder-quobyte-4730852c-85d0-4a1c-9c53-fb9f37fcf6ec-9ea481b8-1e1d-4d7c-aebe-47ce449c4544" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:39:08 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Creating volume 9ea481b8-1e1d-4d7c-aebe-47ce449c4544 from snapshot 4730852c-85d0-4a1c-9c53-fb9f37fcf6ec {{(pid=86703) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 15:39:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:08 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:39:08 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:39:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:08 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:39:08 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Acquiring lock "cinder-quobyte-9ea481b8-1e1d-4d7c-aebe-47ce449c4544" by "_copy_volume_from_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:39:08 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Lock "cinder-quobyte-9ea481b8-1e1d-4d7c-aebe-47ce449c4544" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:39:08 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] snapshot: 4730852c-85d0-4a1c-9c53-fb9f37fcf6ec, volume: 9ea481b8-1e1d-4d7c-aebe-47ce449c4544, {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 15:39:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:08 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:39:08 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:39:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:08 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[11573d8a-e16a-43cb-a7c2-9af7b6cb0d8c]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:39:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8.4730852c-85d0-4a1c-9c53-fb9f37fcf6ec {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:09 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-7ca5a476-7afd-4cd7-b09d-a1b63a5b784b tempest-GroupSnapshotsTest-2041888239 None] Create group from source-snapshot-48f6102b-08cb-4471-954a-d4fe9ad53487 completed successfully. Nov 02 15:39:09 devstack sudo[99383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8.4730852c-85d0-4a1c-9c53-fb9f37fcf6ec Nov 02 15:39:09 devstack sudo[99383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:09 devstack sudo[99383]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8.4730852c-85d0-4a1c-9c53-fb9f37fcf6ec" returned: 0 in 0.617s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:09 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:39:09 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfaa5651-d602-4399-9849-505033e1eecd]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:39:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:09 devstack sudo[99395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8 Nov 02 15:39:09 devstack sudo[99395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:10 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-18aadba5-b895-49b2-9d1c-15da34a942bf tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "cinder-quobyte-0c919ef0-65a6-4c2f-a04a-ce631870d3f7" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:39:10 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-18aadba5-b895-49b2-9d1c-15da34a942bf tempest-GroupSnapshotsTest-2041888239 None] Lock "cinder-quobyte-0c919ef0-65a6-4c2f-a04a-ce631870d3f7" acquired by "delete_volume" :: waited 0.019s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:39:10 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82d5e4e-6740-4ce4-a06d-f403d4498f8e]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:39:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-18aadba5-b895-49b2-9d1c-15da34a942bf tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0c919ef0-65a6-4c2f-a04a-ce631870d3f7 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:10 devstack sudo[99395]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8" returned: 0 in 0.701s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] will copy from snapshot at /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8 {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 15:39:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Creating direct copy from snapshot {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 15:39:10 devstack sudo[99399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0c919ef0-65a6-4c2f-a04a-ce631870d3f7 Nov 02 15:39:10 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:10 devstack cinder-volume[86703]: DEBUG cinder.utils [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Path /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9ea481b8-1e1d-4d7c-aebe-47ce449c4544 not found in is_blk_device check {{(pid=86703) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 15:39:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9ea481b8-1e1d-4d7c-aebe-47ce449c4544 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:10 devstack sudo[99402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9ea481b8-1e1d-4d7c-aebe-47ce449c4544 Nov 02 15:39:10 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:10 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-18aadba5-b895-49b2-9d1c-15da34a942bf tempest-GroupSnapshotsTest-2041888239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0c919ef0-65a6-4c2f-a04a-ce631870d3f7" returned: 0 in 0.659s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-18aadba5-b895-49b2-9d1c-15da34a942bf tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0c919ef0-65a6-4c2f-a04a-ce631870d3f7 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:10 devstack sudo[99410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0c919ef0-65a6-4c2f-a04a-ce631870d3f7 Nov 02 15:39:10 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:11 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-18aadba5-b895-49b2-9d1c-15da34a942bf tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0c919ef0-65a6-4c2f-a04a-ce631870d3f7" returned: 0 in 0.513s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:11 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-18aadba5-b895-49b2-9d1c-15da34a942bf tempest-GroupSnapshotsTest-2041888239 None] Lock "cinder-quobyte-0c919ef0-65a6-4c2f-a04a-ce631870d3f7" released by "delete_volume" :: held 1.268s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:39:11 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-18aadba5-b895-49b2-9d1c-15da34a942bf tempest-GroupSnapshotsTest-2041888239 None] Created reservations ['8348e506-c6e5-415f-af06-efa465558252'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:39:11 devstack cinder-volume[86703]: WARNING cinder.quota [None req-18aadba5-b895-49b2-9d1c-15da34a942bf tempest-GroupSnapshotsTest-2041888239 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-338183087 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-338183087, it is now deprecated. Please use the default quota class for default quota. Nov 02 15:39:11 devstack cinder-volume[86703]: WARNING cinder.quota [None req-18aadba5-b895-49b2-9d1c-15da34a942bf tempest-GroupSnapshotsTest-2041888239 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-338183087 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-338183087, it is now deprecated. Please use the default quota class for default quota. Nov 02 15:39:11 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-18aadba5-b895-49b2-9d1c-15da34a942bf tempest-GroupSnapshotsTest-2041888239 None] Created reservations ['469cdbed-26a6-43f6-9658-3bcd84e95512', 'a8407ebc-6659-4f3e-898d-e0b95d8ff7e1', 'b59a46f7-3614-412d-8554-df7dbf5207b6', 'ef57c3a6-4f6b-419d-8021-109c82e88213'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:39:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-18aadba5-b895-49b2-9d1c-15da34a942bf tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-18aadba5-b895-49b2-9d1c-15da34a942bf tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-18aadba5-b895-49b2-9d1c-15da34a942bf tempest-GroupSnapshotsTest-2041888239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:39:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-18aadba5-b895-49b2-9d1c-15da34a942bf tempest-GroupSnapshotsTest-2041888239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:39:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-18aadba5-b895-49b2-9d1c-15da34a942bf tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-18aadba5-b895-49b2-9d1c-15da34a942bf tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:12 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:39:12 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:13 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-18aadba5-b895-49b2-9d1c-15da34a942bf tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.914s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:13 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-18aadba5-b895-49b2-9d1c-15da34a942bf tempest-GroupSnapshotsTest-2041888239 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:39:13 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-18aadba5-b895-49b2-9d1c-15da34a942bf tempest-GroupSnapshotsTest-2041888239 None] Delete group completed successfully. Nov 02 15:39:13 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-46cc1518-cac9-4a96-9932-9125a57e4144 tempest-GroupSnapshotsTest-2041888239 None] group_snapshot 48f6102b-08cb-4471-954a-d4fe9ad53487: deleting Nov 02 15:39:13 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-46cc1518-cac9-4a96-9932-9125a57e4144 tempest-GroupSnapshotsTest-2041888239 None] group_snapshot 48f6102b-08cb-4471-954a-d4fe9ad53487: deleting {{(pid=86703) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 15:39:13 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-46cc1518-cac9-4a96-9932-9125a57e4144 tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "cinder-quobyte-bf775072-dc17-4bdf-a2fd-189e713b45d6" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:39:13 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-46cc1518-cac9-4a96-9932-9125a57e4144 tempest-GroupSnapshotsTest-2041888239 None] Lock "cinder-quobyte-bf775072-dc17-4bdf-a2fd-189e713b45d6" acquired by "delete_snapshot" :: waited 0.067s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:39:13 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-46cc1518-cac9-4a96-9932-9125a57e4144 tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "cinder-quobyte-b07695a0-76d6-40ca-ada9-edeafd5b690f" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:39:13 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-46cc1518-cac9-4a96-9932-9125a57e4144 tempest-GroupSnapshotsTest-2041888239 None] Lock "cinder-quobyte-b07695a0-76d6-40ca-ada9-edeafd5b690f" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:39:13 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-46cc1518-cac9-4a96-9932-9125a57e4144 tempest-GroupSnapshotsTest-2041888239 None] Deleting offline snapshot b07695a0-76d6-40ca-ada9-edeafd5b690f of volume bf775072-dc17-4bdf-a2fd-189e713b45d6 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:39:13 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-46cc1518-cac9-4a96-9932-9125a57e4144 tempest-GroupSnapshotsTest-2041888239 None] snapshot_file for this snap is: volume-bf775072-dc17-4bdf-a2fd-189e713b45d6.b07695a0-76d6-40ca-ada9-edeafd5b690f {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:39:13 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[13736c6d-2321-46eb-b3e5-6541542e499a]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:39:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-46cc1518-cac9-4a96-9932-9125a57e4144 tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6.b07695a0-76d6-40ca-ada9-edeafd5b690f {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:13 devstack sudo[99447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6.b07695a0-76d6-40ca-ada9-edeafd5b690f Nov 02 15:39:13 devstack sudo[99447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:14 devstack sudo[99447]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-46cc1518-cac9-4a96-9932-9125a57e4144 tempest-GroupSnapshotsTest-2041888239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6.b07695a0-76d6-40ca-ada9-edeafd5b690f" returned: 0 in 1.148s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:14 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-46cc1518-cac9-4a96-9932-9125a57e4144 tempest-GroupSnapshotsTest-2041888239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf775072-dc17-4bdf-a2fd-189e713b45d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:39:14 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb892164-6ba7-41db-98c4-3af10e630641]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:39:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-46cc1518-cac9-4a96-9932-9125a57e4144 tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:15 devstack sudo[99453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6 Nov 02 15:39:15 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:16 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-46cc1518-cac9-4a96-9932-9125a57e4144 tempest-GroupSnapshotsTest-2041888239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6" returned: 0 in 1.395s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-46cc1518-cac9-4a96-9932-9125a57e4144 tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6.b07695a0-76d6-40ca-ada9-edeafd5b690f {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:16 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6.b07695a0-76d6-40ca-ada9-edeafd5b690f Nov 02 15:39:16 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:17 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-46cc1518-cac9-4a96-9932-9125a57e4144 tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6.b07695a0-76d6-40ca-ada9-edeafd5b690f" returned: 0 in 0.971s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-46cc1518-cac9-4a96-9932-9125a57e4144 tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6.b07695a0-76d6-40ca-ada9-edeafd5b690f {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:17 devstack sudo[99470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6.b07695a0-76d6-40ca-ada9-edeafd5b690f Nov 02 15:39:17 devstack sudo[99470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:18 devstack sudo[99470]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-46cc1518-cac9-4a96-9932-9125a57e4144 tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6.b07695a0-76d6-40ca-ada9-edeafd5b690f" returned: 0 in 0.981s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:18 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-46cc1518-cac9-4a96-9932-9125a57e4144 tempest-GroupSnapshotsTest-2041888239 None] Lock "cinder-quobyte-b07695a0-76d6-40ca-ada9-edeafd5b690f" released by "_delete_snapshot" :: held 4.804s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:39:18 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-46cc1518-cac9-4a96-9932-9125a57e4144 tempest-GroupSnapshotsTest-2041888239 None] Lock "cinder-quobyte-bf775072-dc17-4bdf-a2fd-189e713b45d6" released by "delete_snapshot" :: held 4.877s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:39:18 devstack cinder-volume[86703]: WARNING cinder.quota [None req-46cc1518-cac9-4a96-9932-9125a57e4144 tempest-GroupSnapshotsTest-2041888239 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-338183087 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-338183087, it is now deprecated. Please use the default quota class for default quota. Nov 02 15:39:18 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-46cc1518-cac9-4a96-9932-9125a57e4144 tempest-GroupSnapshotsTest-2041888239 None] Created reservations ['cd750959-c317-4576-9c46-bffaa9332b6c', 'e76ddea8-ce2b-4cec-92e4-e05c2d51799f', 'e1c2e8e4-04c9-4261-a40a-6e5c8c9bc729', '9cbcef0e-fbbc-4e4b-96a9-42fcfa584211'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:39:18 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-46cc1518-cac9-4a96-9932-9125a57e4144 tempest-GroupSnapshotsTest-2041888239 None] group_snapshot 48f6102b-08cb-4471-954a-d4fe9ad53487: deleted successfully Nov 02 15:39:19 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:39:19 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] Flow 'volume_create_manager' (36b93efc-bae9-4825-8414-ff8e49eeb32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:39:19 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b5540f2-8856-44cf-829b-6daef1ae8e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:19 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b5540f2-8856-44cf-829b-6daef1ae8e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1745281339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96b5158c-891f-4894-8b17-041600454246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c202f05c867f4140bc46e2e0452f66e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:39:19Z,use_quota=True,user_id='f79e40399c8f4789b37090fded243680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:19 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dba9833-3740-4878-8511-8f6ee58344c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:19 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dba9833-3740-4878-8511-8f6ee58344c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:19 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c74605-a90c-42c6-bd9d-9571f3ce4b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:19 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c74605-a90c-42c6-bd9d-9571f3ce4b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96b5158c-891f-4894-8b17-041600454246', 'volume_name': 'volume-96b5158c-891f-4894-8b17-041600454246', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:19 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ae1aa1-5f1b-444f-86ae-61309800355d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:19 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ae1aa1-5f1b-444f-86ae-61309800355d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:19 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efd0fd8b-1e06-4427-8b28-b5ad3020bace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:19 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] Volume 96b5158c-891f-4894-8b17-041600454246: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96b5158c-891f-4894-8b17-041600454246', 'volume_size': 1} Nov 02 15:39:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:20 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-096d5a20-c8ed-482c-a53a-32aaa4549bec tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "cinder-quobyte-bf775072-dc17-4bdf-a2fd-189e713b45d6" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:39:20 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-096d5a20-c8ed-482c-a53a-32aaa4549bec tempest-GroupSnapshotsTest-2041888239 None] Lock "cinder-quobyte-bf775072-dc17-4bdf-a2fd-189e713b45d6" acquired by "delete_volume" :: waited 0.028s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:39:20 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[267b6bbb-ede7-4d4a-bed9-431eb8278fdb]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:39:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-096d5a20-c8ed-482c-a53a-32aaa4549bec tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:20 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:39:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:39:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:39:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:20 devstack sudo[99512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:39:20 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:20 devstack sudo[99511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6 Nov 02 15:39:20 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:21 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.924s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:21 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:39:21 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager._thread_info {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:39:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread count: 29 {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 15:39:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread info: [<_MainThread(MainThread, started 125876361756800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 15:39:21 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-096d5a20-c8ed-482c-a53a-32aaa4549bec tempest-GroupSnapshotsTest-2041888239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6" returned: 0 in 1.424s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-096d5a20-c8ed-482c-a53a-32aaa4549bec tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:21 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6 Nov 02 15:39:21 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:22 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-096d5a20-c8ed-482c-a53a-32aaa4549bec tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf775072-dc17-4bdf-a2fd-189e713b45d6" returned: 0 in 0.542s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:22 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-096d5a20-c8ed-482c-a53a-32aaa4549bec tempest-GroupSnapshotsTest-2041888239 None] Lock "cinder-quobyte-bf775072-dc17-4bdf-a2fd-189e713b45d6" released by "delete_volume" :: held 2.281s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:39:22 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-096d5a20-c8ed-482c-a53a-32aaa4549bec tempest-GroupSnapshotsTest-2041888239 None] Created reservations ['eb06bd98-0614-4c74-b8e3-3cad15d9ff7e'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:39:22 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9ea481b8-1e1d-4d7c-aebe-47ce449c4544" returned: 0 in 12.421s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:22 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Image conversion details: src /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8, size 1024.00 MB, duration 12.42 sec, destination /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9ea481b8-1e1d-4d7c-aebe-47ce449c4544 {{(pid=86703) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 15:39:22 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Converted 1024.00 MB image at 82.43 MB/s Nov 02 15:39:22 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9ea481b8-1e1d-4d7c-aebe-47ce449c4544 is being set with open permissions: ugo+rw Nov 02 15:39:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9ea481b8-1e1d-4d7c-aebe-47ce449c4544 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:22 devstack cinder-volume[86703]: WARNING cinder.db.api [None req-096d5a20-c8ed-482c-a53a-32aaa4549bec tempest-GroupSnapshotsTest-2041888239 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-338183087'] Nov 02 15:39:22 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9ea481b8-1e1d-4d7c-aebe-47ce449c4544 Nov 02 15:39:22 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:22 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-096d5a20-c8ed-482c-a53a-32aaa4549bec tempest-GroupSnapshotsTest-2041888239 None] Created reservations ['8fba61bb-cd7b-418f-96f7-350624978bd0', '97b43e7a-4a55-4e76-92ee-5463ad6f4009', '30c218fd-1ef0-4563-acca-2e2f82c8bddc', '5c82c818-2cb8-45d0-8d0a-611c88b593a7'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:39:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-096d5a20-c8ed-482c-a53a-32aaa4549bec tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-096d5a20-c8ed-482c-a53a-32aaa4549bec tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:23 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-096d5a20-c8ed-482c-a53a-32aaa4549bec tempest-GroupSnapshotsTest-2041888239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:39:23 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-096d5a20-c8ed-482c-a53a-32aaa4549bec tempest-GroupSnapshotsTest-2041888239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:39:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-096d5a20-c8ed-482c-a53a-32aaa4549bec tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-096d5a20-c8ed-482c-a53a-32aaa4549bec tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:23 devstack sudo[99524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:39:23 devstack sudo[99524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:23 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9ea481b8-1e1d-4d7c-aebe-47ce449c4544" returned: 0 in 0.441s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:23 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Lock "cinder-quobyte-9ea481b8-1e1d-4d7c-aebe-47ce449c4544" released by "_copy_volume_from_snapshot" :: held 14.349s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:39:23 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Lock "cinder-quobyte-4730852c-85d0-4a1c-9c53-fb9f37fcf6ec-9ea481b8-1e1d-4d7c-aebe-47ce449c4544" released by "_create_volume_from_snapshot" :: held 14.456s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:39:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.496s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.297s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:23 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:39:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1205213657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1e9a88-d218-4b23-a612-31a97f684cd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c2160dba0ca421690bf8de1d9331d0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:39:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:39:05Z,use_quota=True,user_id='9a29873b617a4b4a98e28a3b2632ebf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae39ca0-c95b-4f7e-a414-53c7490898ff),volume_type_id=6ae39ca0-c95b-4f7e-a414-53c7490898ff)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:39:23 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Creating volume 4e1e9a88-d218-4b23-a612-31a97f684cd5 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:39:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:23 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:39:23 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:39:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:23 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:39:23 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:39:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e1e9a88-d218-4b23-a612-31a97f684cd5 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:23 devstack sudo[99524]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:23 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e1e9a88-d218-4b23-a612-31a97f684cd5 1073741824 Nov 02 15:39:23 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-096d5a20-c8ed-482c-a53a-32aaa4549bec tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.296s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:23 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-096d5a20-c8ed-482c-a53a-32aaa4549bec tempest-GroupSnapshotsTest-2041888239 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:39:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f20ec7a-2e33-46f8-a405-0dc1727a9e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ea481b8-1e1d-4d7c-aebe-47ce449c4544', 'volume_size': 1, 'snapshot_id': '4730852c-85d0-4a1c-9c53-fb9f37fcf6ec'}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74bb72f-9d91-4fad-a038-d43f64d84b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:23 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-096d5a20-c8ed-482c-a53a-32aaa4549bec tempest-GroupSnapshotsTest-2041888239 None] Delete group completed successfully. Nov 02 15:39:23 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Volume volume-9ea481b8-1e1d-4d7c-aebe-47ce449c4544 (9ea481b8-1e1d-4d7c-aebe-47ce449c4544): created successfully Nov 02 15:39:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74bb72f-9d91-4fad-a038-d43f64d84b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Flow 'volume_create_manager' (3c6eb4ad-62c4-49b3-9398-9869b9f3ad6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:39:23 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-de0163a7-f6a6-4d2a-bc73-d3e1f41f2b06 tempest-TestStampPattern-141219102 None] Created volume successfully. Nov 02 15:39:23 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e1e9a88-d218-4b23-a612-31a97f684cd5 1073741824" returned: 0 in 0.519s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e1e9a88-d218-4b23-a612-31a97f684cd5 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:23 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e1e9a88-d218-4b23-a612-31a97f684cd5 Nov 02 15:39:23 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:24 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e1e9a88-d218-4b23-a612-31a97f684cd5" returned: 0 in 0.283s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:39:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.719s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1745281339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96b5158c-891f-4894-8b17-041600454246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c202f05c867f4140bc46e2e0452f66e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:39:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:39:19Z,use_quota=True,user_id='f79e40399c8f4789b37090fded243680',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:39:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] Creating volume 96b5158c-891f-4894-8b17-041600454246 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:39:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:39:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:39:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:39:24 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:39:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-96b5158c-891f-4894-8b17-041600454246 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321c31bb-d51f-4f88-9c61-39f79a8dc3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e1e9a88-d218-4b23-a612-31a97f684cd5', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:24 devstack sudo[99536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-96b5158c-891f-4894-8b17-041600454246 1073741824 Nov 02 15:39:24 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1b189e3-f8fd-4699-80cb-d1484579c9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:24 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Volume volume-4e1e9a88-d218-4b23-a612-31a97f684cd5 (4e1e9a88-d218-4b23-a612-31a97f684cd5): created successfully Nov 02 15:39:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1b189e3-f8fd-4699-80cb-d1484579c9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Flow 'volume_create_manager' (bba34150-bf6a-45f4-b19f-ee4da3586b36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:39:24 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-1eda8eb9-a659-49dc-9de4-2339d234ff78 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Created volume successfully. Nov 02 15:39:24 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-cad1e8da-be0c-4324-801b-0e5644bd5e94 tempest-GroupSnapshotsTest-2041888239 None] Group tempest-GroupSnapshotsTest-Group-701784421: creating Nov 02 15:39:24 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-96b5158c-891f-4894-8b17-041600454246 1073741824" returned: 0 in 0.658s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:24 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-cad1e8da-be0c-4324-801b-0e5644bd5e94 tempest-GroupSnapshotsTest-2041888239 None] Group tempest-GroupSnapshotsTest-Group-701784421: created successfully Nov 02 15:39:24 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-cad1e8da-be0c-4324-801b-0e5644bd5e94 tempest-GroupSnapshotsTest-2041888239 None] Create group completed successfully. Nov 02 15:39:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-96b5158c-891f-4894-8b17-041600454246 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:24 devstack sudo[99542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-96b5158c-891f-4894-8b17-041600454246 Nov 02 15:39:24 devstack sudo[99542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:25 devstack sudo[99542]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-96b5158c-891f-4894-8b17-041600454246" returned: 0 in 0.313s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:39:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efd0fd8b-1e06-4427-8b28-b5ad3020bace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96b5158c-891f-4894-8b17-041600454246', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3efbeb-6a0f-4b30-9528-0b5b03a7e65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:25 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] Volume volume-96b5158c-891f-4894-8b17-041600454246 (96b5158c-891f-4894-8b17-041600454246): created successfully Nov 02 15:39:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d3efbeb-6a0f-4b30-9528-0b5b03a7e65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] Flow 'volume_create_manager' (36b93efc-bae9-4825-8414-ff8e49eeb32f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:39:25 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-9358d4c9-4af7-4d5f-9080-909011d834d3 tempest-VolumesMetadataTest-1809931557 None] Created volume successfully. Nov 02 15:39:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8905eb36-ccd2-4590-86d0-44dafcb20b01 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8905eb36-ccd2-4590-86d0-44dafcb20b01 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8905eb36-ccd2-4590-86d0-44dafcb20b01 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:39:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8905eb36-ccd2-4590-86d0-44dafcb20b01 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:39:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8905eb36-ccd2-4590-86d0-44dafcb20b01 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8905eb36-ccd2-4590-86d0-44dafcb20b01 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:25 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:39:25 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:26 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8905eb36-ccd2-4590-86d0-44dafcb20b01 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.535s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:26 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-8905eb36-ccd2-4590-86d0-44dafcb20b01 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:39:26 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-8905eb36-ccd2-4590-86d0-44dafcb20b01 tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Retype volume completed successfully. Nov 02 15:39:26 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:UPDATE=135,cinder:SELECT=130,cinder:DELETE=12,cinder:INSERT=43 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:39:26 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:UPDATE=148,cinder:SELECT=129,cinder:INSERT=30,cinder:DELETE=4 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:39:26 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:39:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] Flow 'volume_create_manager' (6bfa8758-e24c-43ed-853d-63845823cb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:39:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8353294f-0c6c-46cd-a05e-05e30863ddfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8353294f-0c6c-46cd-a05e-05e30863ddfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2099388604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a2fc2c1d-bc91-4eb3-af9f-0a83b6caf699,host='devstack@QuobyteHD#QuobyteHD',id=a6d660d5-45e8-42bb-88ec-e4a2d125e8dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad9598ccb614ffea3d47292cc4aa60d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:39:27Z,use_quota=True,user_id='73ff6941c0b043a392e5b56e97b46f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e748dade-16a3-429a-8078-eafcc17084bb),volume_type_id=e748dade-16a3-429a-8078-eafcc17084bb)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4d04030-5ed4-411b-93d2-c83bc8f5570e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4d04030-5ed4-411b-93d2-c83bc8f5570e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06ca77bd-5a75-4e9a-b3de-df8ac766d5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06ca77bd-5a75-4e9a-b3de-df8ac766d5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6d660d5-45e8-42bb-88ec-e4a2d125e8dd', 'volume_name': 'volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbfc73d-877d-43a0-9cca-4a03df3d2cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbfc73d-877d-43a0-9cca-4a03df3d2cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf4b1d9c-c32a-4f8c-a208-f77a0dcc2eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:27 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] Volume a6d660d5-45e8-42bb-88ec-e4a2d125e8dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd', 'volume_size': 1} Nov 02 15:39:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:27 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a2fc2c1d-bc91-4eb3-af9f-0a83b6caf699,created_at=2026-11-02T14:39:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2099388604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a2fc2c1d-bc91-4eb3-af9f-0a83b6caf699,host='devstack@QuobyteHD#QuobyteHD',id=a6d660d5-45e8-42bb-88ec-e4a2d125e8dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad9598ccb614ffea3d47292cc4aa60d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:39:27Z,use_quota=True,user_id='73ff6941c0b043a392e5b56e97b46f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e748dade-16a3-429a-8078-eafcc17084bb),volume_type_id=e748dade-16a3-429a-8078-eafcc17084bb)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:39:27 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] Creating volume a6d660d5-45e8-42bb-88ec-e4a2d125e8dd {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:39:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:27 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:39:27 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:39:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:27 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:39:27 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:39:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:27 devstack sudo[99552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd 1073741824 Nov 02 15:39:27 devstack sudo[99552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6d17c2a2-e366-4d87-9c1a-ae920aa31732 tempest-VolumesMetadataTest-1809931557 None] Acquiring lock "cinder-96b5158c-891f-4894-8b17-041600454246-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:39:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-94e550e3-b1b7-4785-84b2-6aecafd4322f tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Acquiring lock "cinder-4e1e9a88-d218-4b23-a612-31a97f684cd5-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:39:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-94e550e3-b1b7-4785-84b2-6aecafd4322f tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Lock "cinder-4e1e9a88-d218-4b23-a612-31a97f684cd5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:39:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6d17c2a2-e366-4d87-9c1a-ae920aa31732 tempest-VolumesMetadataTest-1809931557 None] Lock "cinder-96b5158c-891f-4894-8b17-041600454246-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:39:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-94e550e3-b1b7-4785-84b2-6aecafd4322f tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Acquiring lock "cinder-quobyte-4e1e9a88-d218-4b23-a612-31a97f684cd5" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:39:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6d17c2a2-e366-4d87-9c1a-ae920aa31732 tempest-VolumesMetadataTest-1809931557 None] Acquiring lock "cinder-quobyte-96b5158c-891f-4894-8b17-041600454246" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:39:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-94e550e3-b1b7-4785-84b2-6aecafd4322f tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Lock "cinder-quobyte-4e1e9a88-d218-4b23-a612-31a97f684cd5" acquired by "delete_volume" :: waited 0.047s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:39:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6d17c2a2-e366-4d87-9c1a-ae920aa31732 tempest-VolumesMetadataTest-1809931557 None] Lock "cinder-quobyte-96b5158c-891f-4894-8b17-041600454246" acquired by "delete_volume" :: waited 0.043s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:39:27 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a8cfc2-d497-4087-8e32-162b34028878]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:39:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-94e550e3-b1b7-4785-84b2-6aecafd4322f tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e1e9a88-d218-4b23-a612-31a97f684cd5 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:27 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9edcc5-45e2-4298-bd66-ec42aa4dfdca]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:39:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6d17c2a2-e366-4d87-9c1a-ae920aa31732 tempest-VolumesMetadataTest-1809931557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-96b5158c-891f-4894-8b17-041600454246 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:27 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e1e9a88-d218-4b23-a612-31a97f684cd5 Nov 02 15:39:27 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:27 devstack sudo[99558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-96b5158c-891f-4894-8b17-041600454246 Nov 02 15:39:27 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:27 devstack sudo[99552]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd 1073741824" returned: 0 in 0.701s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:27 devstack sudo[99562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd Nov 02 15:39:27 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:28 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-94e550e3-b1b7-4785-84b2-6aecafd4322f tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e1e9a88-d218-4b23-a612-31a97f684cd5" returned: 0 in 0.474s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-94e550e3-b1b7-4785-84b2-6aecafd4322f tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e1e9a88-d218-4b23-a612-31a97f684cd5 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:28 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e1e9a88-d218-4b23-a612-31a97f684cd5 Nov 02 15:39:28 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:28 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6d17c2a2-e366-4d87-9c1a-ae920aa31732 tempest-VolumesMetadataTest-1809931557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-96b5158c-891f-4894-8b17-041600454246" returned: 0 in 0.484s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6d17c2a2-e366-4d87-9c1a-ae920aa31732 tempest-VolumesMetadataTest-1809931557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-96b5158c-891f-4894-8b17-041600454246 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:28 devstack sudo[99572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-96b5158c-891f-4894-8b17-041600454246 Nov 02 15:39:28 devstack sudo[99572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:28 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd" returned: 0 in 0.490s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:39:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.269s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf4b1d9c-c32a-4f8c-a208-f77a0dcc2eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (575af9f3-ac3b-446c-89fa-03b506bb26d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:28 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-94e550e3-b1b7-4785-84b2-6aecafd4322f tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e1e9a88-d218-4b23-a612-31a97f684cd5" returned: 0 in 0.327s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:28 devstack sudo[99572]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:28 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-94e550e3-b1b7-4785-84b2-6aecafd4322f tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Lock "cinder-quobyte-4e1e9a88-d218-4b23-a612-31a97f684cd5" released by "delete_volume" :: held 0.878s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:39:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6d17c2a2-e366-4d87-9c1a-ae920aa31732 tempest-VolumesMetadataTest-1809931557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-96b5158c-891f-4894-8b17-041600454246" returned: 0 in 0.316s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:28 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6d17c2a2-e366-4d87-9c1a-ae920aa31732 tempest-VolumesMetadataTest-1809931557 None] Lock "cinder-quobyte-96b5158c-891f-4894-8b17-041600454246" released by "delete_volume" :: held 0.866s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:39:28 devstack cinder-volume[86703]: WARNING cinder.quota [None req-94e550e3-b1b7-4785-84b2-6aecafd4322f tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 02 15:39:28 devstack cinder-volume[86703]: WARNING cinder.quota [None req-94e550e3-b1b7-4785-84b2-6aecafd4322f tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 02 15:39:28 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] Volume volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd (a6d660d5-45e8-42bb-88ec-e4a2d125e8dd): created successfully Nov 02 15:39:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (575af9f3-ac3b-446c-89fa-03b506bb26d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] Flow 'volume_create_manager' (6bfa8758-e24c-43ed-853d-63845823cb02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:39:28 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-94e550e3-b1b7-4785-84b2-6aecafd4322f tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Created reservations ['9cbf1e0d-bec5-4b08-aa63-44e0b490905d', 'ea333c65-813d-477f-85b0-3b83d81f6f8e', '2dcc3cff-b971-4134-9511-e565f03575a8', 'ff1d60bc-3d32-436c-82bb-946843a36248'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:39:28 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-6d17c2a2-e366-4d87-9c1a-ae920aa31732 tempest-VolumesMetadataTest-1809931557 None] Created reservations ['6495c807-ec73-4b8f-ba32-ee2ef19cb4aa', 'aefe5a73-cbea-4540-ac54-9295f95404bf', '3d8a7d50-d0cd-4f47-a6bb-e685ed662df8', '9594437e-8b6c-498c-acfd-a2b1dd0b7ba3'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:39:28 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-cb264c37-93a7-4727-9727-075aabf2f50b tempest-GroupSnapshotsTest-2041888239 None] Created volume successfully. Nov 02 15:39:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-6d17c2a2-e366-4d87-9c1a-ae920aa31732 tempest-VolumesMetadataTest-1809931557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-6d17c2a2-e366-4d87-9c1a-ae920aa31732 tempest-VolumesMetadataTest-1809931557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-6d17c2a2-e366-4d87-9c1a-ae920aa31732 tempest-VolumesMetadataTest-1809931557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:39:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-6d17c2a2-e366-4d87-9c1a-ae920aa31732 tempest-VolumesMetadataTest-1809931557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:39:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-6d17c2a2-e366-4d87-9c1a-ae920aa31732 tempest-VolumesMetadataTest-1809931557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6d17c2a2-e366-4d87-9c1a-ae920aa31732 tempest-VolumesMetadataTest-1809931557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:28 devstack sudo[99577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:39:28 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-94e550e3-b1b7-4785-84b2-6aecafd4322f tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-94e550e3-b1b7-4785-84b2-6aecafd4322f tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-94e550e3-b1b7-4785-84b2-6aecafd4322f tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:39:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-94e550e3-b1b7-4785-84b2-6aecafd4322f tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:39:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-94e550e3-b1b7-4785-84b2-6aecafd4322f tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-94e550e3-b1b7-4785-84b2-6aecafd4322f tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:28 devstack sudo[99579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:39:28 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:29 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6d17c2a2-e366-4d87-9c1a-ae920aa31732 tempest-VolumesMetadataTest-1809931557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.267s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:29 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-6d17c2a2-e366-4d87-9c1a-ae920aa31732 tempest-VolumesMetadataTest-1809931557 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:39:29 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-6d17c2a2-e366-4d87-9c1a-ae920aa31732 tempest-VolumesMetadataTest-1809931557 None] Deleted volume successfully. Nov 02 15:39:29 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6d17c2a2-e366-4d87-9c1a-ae920aa31732 tempest-VolumesMetadataTest-1809931557 None] Lock "cinder-96b5158c-891f-4894-8b17-041600454246-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:39:29 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-94e550e3-b1b7-4785-84b2-6aecafd4322f tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.272s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:29 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-94e550e3-b1b7-4785-84b2-6aecafd4322f tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:39:29 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-94e550e3-b1b7-4785-84b2-6aecafd4322f tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Deleted volume successfully. Nov 02 15:39:29 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-94e550e3-b1b7-4785-84b2-6aecafd4322f tempest-VolumeRetypeWithoutMigrationTest-1135335292 None] Lock "cinder-4e1e9a88-d218-4b23-a612-31a97f684cd5-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:39:30 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:39:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] Flow 'volume_create_manager' (1309cb2a-90fb-4a9a-b3a4-d3e3b07f7eb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:39:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af95b60b-cc67-484e-9001-72da61ae0f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af95b60b-cc67-484e-9001-72da61ae0f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1869472482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a2fc2c1d-bc91-4eb3-af9f-0a83b6caf699,host='devstack@QuobyteHD#QuobyteHD',id=a4b4743d-7867-420d-a9b8-b437e81cf74b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad9598ccb614ffea3d47292cc4aa60d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:39:30Z,use_quota=True,user_id='73ff6941c0b043a392e5b56e97b46f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e748dade-16a3-429a-8078-eafcc17084bb),volume_type_id=e748dade-16a3-429a-8078-eafcc17084bb)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb77a9f7-073d-4957-8d6a-f3affd6237c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb77a9f7-073d-4957-8d6a-f3affd6237c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db5e5a8e-bfec-44b5-a3d0-510c11b051bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db5e5a8e-bfec-44b5-a3d0-510c11b051bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4b4743d-7867-420d-a9b8-b437e81cf74b', 'volume_name': 'volume-a4b4743d-7867-420d-a9b8-b437e81cf74b', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e4268c0-a53e-4449-bec1-9293b97a6e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e4268c0-a53e-4449-bec1-9293b97a6e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f6afa7-00d1-42ba-91f5-313cecd723e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:30 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] Volume a4b4743d-7867-420d-a9b8-b437e81cf74b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4b4743d-7867-420d-a9b8-b437e81cf74b', 'volume_size': 1} Nov 02 15:39:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a2fc2c1d-bc91-4eb3-af9f-0a83b6caf699,created_at=2026-11-02T14:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1869472482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a2fc2c1d-bc91-4eb3-af9f-0a83b6caf699,host='devstack@QuobyteHD#QuobyteHD',id=a4b4743d-7867-420d-a9b8-b437e81cf74b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad9598ccb614ffea3d47292cc4aa60d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:39:30Z,use_quota=True,user_id='73ff6941c0b043a392e5b56e97b46f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e748dade-16a3-429a-8078-eafcc17084bb),volume_type_id=e748dade-16a3-429a-8078-eafcc17084bb)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:39:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] Creating volume a4b4743d-7867-420d-a9b8-b437e81cf74b {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:39:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:39:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:39:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:39:30 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:39:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:30 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b 1073741824 Nov 02 15:39:30 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:31 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b 1073741824" returned: 0 in 0.713s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:31 devstack sudo[99589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b Nov 02 15:39:31 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:31 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b" returned: 0 in 0.434s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] <== create_volume: return (1239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:39:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f6afa7-00d1-42ba-91f5-313cecd723e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4b4743d-7867-420d-a9b8-b437e81cf74b', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (592cd728-6afe-4125-a03f-0b08a7ce29c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:31 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] Volume volume-a4b4743d-7867-420d-a9b8-b437e81cf74b (a4b4743d-7867-420d-a9b8-b437e81cf74b): created successfully Nov 02 15:39:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (592cd728-6afe-4125-a03f-0b08a7ce29c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] Flow 'volume_create_manager' (1309cb2a-90fb-4a9a-b3a4-d3e3b07f7eb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:39:31 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-473322fe-afcd-4cb8-a8ed-41deb5f81be3 tempest-GroupSnapshotsTest-2041888239 None] Created volume successfully. Nov 02 15:39:32 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-1148e7a1-9bfa-44ad-9db5-2b139c1c7f44 tempest-GroupSnapshotsTest-2041888239 None] Update group completed successfully. Nov 02 15:39:34 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-ec4037f2-36de-4973-b8c2-f1f292d7ab2f tempest-GroupSnapshotsTest-2041888239 None] Update group completed successfully. Nov 02 15:39:35 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-e8e995ed-1687-4a00-a0a6-a0ff76394bf7 tempest-GroupSnapshotsTest-2041888239 None] Update group completed successfully. Nov 02 15:39:36 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-ef134141-05ed-4ed8-805c-8d665f7af005 tempest-GroupSnapshotsTest-2041888239 None] Update group completed successfully. Nov 02 15:39:36 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:39:36 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] Flow 'volume_create_manager' (1120138c-8752-4789-ac66-b6d71a8a107c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:39:36 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e3760de-c9f0-4500-bc90-09c3417f689b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e3760de-c9f0-4500-bc90-09c3417f689b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-854316570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4807ecb-71c8-4afb-a535-62468d15cea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a02267252fd44cae8fc91d1b7f2a72b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:39:37Z,use_quota=True,user_id='2445177af02342a5a86d3cdc1544d7a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3db65392-5bbd-4410-a63b-f776785ced75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3db65392-5bbd-4410-a63b-f776785ced75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e7aac5-4a3f-4662-a2cc-1ee9ef466b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e7aac5-4a3f-4662-a2cc-1ee9ef466b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4807ecb-71c8-4afb-a535-62468d15cea1', 'volume_name': 'volume-a4807ecb-71c8-4afb-a535-62468d15cea1', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99c35ab8-87ee-4b03-8b2e-d6c9a345c1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99c35ab8-87ee-4b03-8b2e-d6c9a345c1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fbe62c4-8fa3-424e-a423-d977b21c7f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:37 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] Volume a4807ecb-71c8-4afb-a535-62468d15cea1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4807ecb-71c8-4afb-a535-62468d15cea1', 'volume_size': 1} Nov 02 15:39:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:39:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-854316570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4807ecb-71c8-4afb-a535-62468d15cea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a02267252fd44cae8fc91d1b7f2a72b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:39:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:39:37Z,use_quota=True,user_id='2445177af02342a5a86d3cdc1544d7a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:39:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] Creating volume a4807ecb-71c8-4afb-a535-62468d15cea1 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:39:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:39:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:39:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:39:37 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:39:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4807ecb-71c8-4afb-a535-62468d15cea1 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:37 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4807ecb-71c8-4afb-a535-62468d15cea1 1073741824 Nov 02 15:39:37 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:37 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4807ecb-71c8-4afb-a535-62468d15cea1 1073741824" returned: 0 in 0.492s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4807ecb-71c8-4afb-a535-62468d15cea1 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:37 devstack sudo[99607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4807ecb-71c8-4afb-a535-62468d15cea1 Nov 02 15:39:37 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:37 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4807ecb-71c8-4afb-a535-62468d15cea1" returned: 0 in 0.270s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:39:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fbe62c4-8fa3-424e-a423-d977b21c7f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4807ecb-71c8-4afb-a535-62468d15cea1', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5111dcc-876b-4ca7-9794-2bdc718455f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:37 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] Volume volume-a4807ecb-71c8-4afb-a535-62468d15cea1 (a4807ecb-71c8-4afb-a535-62468d15cea1): created successfully Nov 02 15:39:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5111dcc-876b-4ca7-9794-2bdc718455f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] Flow 'volume_create_manager' (1120138c-8752-4789-ac66-b6d71a8a107c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:39:37 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-487d7270-0af3-47d8-96e5-ff0b5197276c tempest-VolumesTransfersTest-541135329 None] Created volume successfully. Nov 02 15:39:38 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] GroupSnapshot 1b221e21-163d-4a0b-89b8-d8c9d501f3b4: creating. Nov 02 15:39:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] Group snapshot 1b221e21-163d-4a0b-89b8-d8c9d501f3b4: creating. {{(pid=86703) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 15:39:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] Creating offline snapshot d4e0f4b9-f886-4b30-98fc-1a698b68993e of volume a6d660d5-45e8-42bb-88ec-e4a2d125e8dd {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:39:38 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae38fa35-e2ae-4b74-8e25-827915e17e84]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:39:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:38 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:39:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Flow 'volume_create_manager' (52a3f6f6-2b57-4ed8-ab9b-04f01464a342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:39:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a30dfad9-f7dd-4c26-880d-53272e7e9093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a30dfad9-f7dd-4c26-880d-53272e7e9093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1987352314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24981403-eeae-4765-b2d4-57d58eef158a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='266e5275824b410fa3ff472fbab7622b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:39:38Z,use_quota=True,user_id='efef85dd59fb4d24bddc0237a51f6aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6ea797f-89cb-4a23-a718-a188ac025949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6ea797f-89cb-4a23-a718-a188ac025949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd9343ca-6a08-4989-a041-1be52d6d6afa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd9343ca-6a08-4989-a041-1be52d6d6afa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24981403-eeae-4765-b2d4-57d58eef158a', 'volume_name': 'volume-24981403-eeae-4765-b2d4-57d58eef158a', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7191bae7-d68d-4a56-bc26-0ac4d05ddcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7191bae7-d68d-4a56-bc26-0ac4d05ddcf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:38 devstack sudo[99610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd Nov 02 15:39:38 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d2a97f-4681-4d7c-a6d3-1b43ce932957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:38 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Volume 24981403-eeae-4765-b2d4-57d58eef158a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24981403-eeae-4765-b2d4-57d58eef158a', 'volume_size': 1} Nov 02 15:39:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:38 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd" returned: 0 in 0.401s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd.d4e0f4b9-f886-4b30-98fc-1a698b68993e 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:38 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd.d4e0f4b9-f886-4b30-98fc-1a698b68993e 1G Nov 02 15:39:38 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:39 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-4ffd338e-58b3-47b3-a976-c675a18c9984 tempest-VolumesTransfersTest-1603662286 None] Transfer volume completed successfully. Nov 02 15:39:39 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd.d4e0f4b9-f886-4b30-98fc-1a698b68993e 1G" returned: 0 in 0.450s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd.d4e0f4b9-f886-4b30-98fc-1a698b68993e {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:39 devstack sudo[99621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd.d4e0f4b9-f886-4b30-98fc-1a698b68993e Nov 02 15:39:39 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:39 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd.d4e0f4b9-f886-4b30-98fc-1a698b68993e" returned: 0 in 0.407s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:39 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd.d4e0f4b9-f886-4b30-98fc-1a698b68993e is being set with open permissions: ugo+rw: NotImplementedError Nov 02 15:39:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd.d4e0f4b9-f886-4b30-98fc-1a698b68993e {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:39 devstack sudo[99626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd.d4e0f4b9-f886-4b30-98fc-1a698b68993e Nov 02 15:39:39 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:39 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd.d4e0f4b9-f886-4b30-98fc-1a698b68993e" returned: 0 in 0.271s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7ca0bc03-5aaa-42ca-9ac2-1d8bc5c94f64 tempest-VolumesTransfersTest-842130971 None] Acquiring lock "cinder-a4807ecb-71c8-4afb-a535-62468d15cea1-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:39:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7ca0bc03-5aaa-42ca-9ac2-1d8bc5c94f64 tempest-VolumesTransfersTest-842130971 None] Lock "cinder-a4807ecb-71c8-4afb-a535-62468d15cea1-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:39:39 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd.info Nov 02 15:39:39 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7ca0bc03-5aaa-42ca-9ac2-1d8bc5c94f64 tempest-VolumesTransfersTest-842130971 None] Acquiring lock "cinder-quobyte-a4807ecb-71c8-4afb-a535-62468d15cea1" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:39:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7ca0bc03-5aaa-42ca-9ac2-1d8bc5c94f64 tempest-VolumesTransfersTest-842130971 None] Lock "cinder-quobyte-a4807ecb-71c8-4afb-a535-62468d15cea1" acquired by "delete_volume" :: waited 0.018s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:39:39 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bcb808-8e60-4919-9912-bb5dc06bbef3]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:39:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7ca0bc03-5aaa-42ca-9ac2-1d8bc5c94f64 tempest-VolumesTransfersTest-842130971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4807ecb-71c8-4afb-a535-62468d15cea1 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:40 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd.info" returned: 0 in 0.259s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:40 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 15:39:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:40 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd.info Nov 02 15:39:40 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:40 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4807ecb-71c8-4afb-a535-62468d15cea1 Nov 02 15:39:40 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:40 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd.info" returned: 0 in 0.273s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:40 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.188s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7ca0bc03-5aaa-42ca-9ac2-1d8bc5c94f64 tempest-VolumesTransfersTest-842130971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4807ecb-71c8-4afb-a535-62468d15cea1" returned: 0 in 0.405s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7ca0bc03-5aaa-42ca-9ac2-1d8bc5c94f64 tempest-VolumesTransfersTest-842130971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4807ecb-71c8-4afb-a535-62468d15cea1 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:40 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] Creating offline snapshot d6ee9ad4-9a1f-405f-ac0e-9f4dec82e2bc of volume a4b4743d-7867-420d-a9b8-b437e81cf74b {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:39:40 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4807ecb-71c8-4afb-a535-62468d15cea1 Nov 02 15:39:40 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:40 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5754e5ea-53a2-45f5-95c7-4eb975c76dbd]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:39:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:40 devstack sudo[99642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b Nov 02 15:39:40 devstack sudo[99642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:40 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7ca0bc03-5aaa-42ca-9ac2-1d8bc5c94f64 tempest-VolumesTransfersTest-842130971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4807ecb-71c8-4afb-a535-62468d15cea1" returned: 0 in 0.259s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7ca0bc03-5aaa-42ca-9ac2-1d8bc5c94f64 tempest-VolumesTransfersTest-842130971 None] Lock "cinder-quobyte-a4807ecb-71c8-4afb-a535-62468d15cea1" released by "delete_volume" :: held 0.719s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:39:40 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-7ca0bc03-5aaa-42ca-9ac2-1d8bc5c94f64 tempest-VolumesTransfersTest-842130971 None] Created reservations ['f41ba43c-d365-44c2-8505-bd0c3473ee0a', '63b32c3a-eac5-40c7-8cf6-b4a8b70ae3e7', '3b743858-7967-4a35-9df1-ce5e4661282d', 'a4811a08-fef8-4eb0-b485-cc8009afbf15'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:39:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7ca0bc03-5aaa-42ca-9ac2-1d8bc5c94f64 tempest-VolumesTransfersTest-842130971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7ca0bc03-5aaa-42ca-9ac2-1d8bc5c94f64 tempest-VolumesTransfersTest-842130971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:40 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7ca0bc03-5aaa-42ca-9ac2-1d8bc5c94f64 tempest-VolumesTransfersTest-842130971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:39:40 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7ca0bc03-5aaa-42ca-9ac2-1d8bc5c94f64 tempest-VolumesTransfersTest-842130971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:39:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7ca0bc03-5aaa-42ca-9ac2-1d8bc5c94f64 tempest-VolumesTransfersTest-842130971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7ca0bc03-5aaa-42ca-9ac2-1d8bc5c94f64 tempest-VolumesTransfersTest-842130971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:40 devstack sudo[99648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:39:40 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:40 devstack sudo[99642]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b" returned: 0 in 0.412s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b.d6ee9ad4-9a1f-405f-ac0e-9f4dec82e2bc 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:40 devstack sudo[99650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b.d6ee9ad4-9a1f-405f-ac0e-9f4dec82e2bc 1G Nov 02 15:39:40 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:41 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7ca0bc03-5aaa-42ca-9ac2-1d8bc5c94f64 tempest-VolumesTransfersTest-842130971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.264s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:41 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-7ca0bc03-5aaa-42ca-9ac2-1d8bc5c94f64 tempest-VolumesTransfersTest-842130971 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:39:41 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-7ca0bc03-5aaa-42ca-9ac2-1d8bc5c94f64 tempest-VolumesTransfersTest-842130971 None] Deleted volume successfully. Nov 02 15:39:41 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7ca0bc03-5aaa-42ca-9ac2-1d8bc5c94f64 tempest-VolumesTransfersTest-842130971 None] Lock "cinder-a4807ecb-71c8-4afb-a535-62468d15cea1-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:39:41 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b.d6ee9ad4-9a1f-405f-ac0e-9f4dec82e2bc 1G" returned: 0 in 0.506s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4b4743d-7867-420d-a9b8-b437e81cf74b -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b.d6ee9ad4-9a1f-405f-ac0e-9f4dec82e2bc {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:41 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4b4743d-7867-420d-a9b8-b437e81cf74b -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b.d6ee9ad4-9a1f-405f-ac0e-9f4dec82e2bc Nov 02 15:39:41 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:41 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:39:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] Flow 'volume_create_manager' (b4fbd000-a7d9-47e9-9358-8817b8f0750c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:39:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (297ce530-c638-4a5e-b31d-923f948fa46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (297ce530-c638-4a5e-b31d-923f948fa46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1860776906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efb937d5-f54b-4fce-bc72-6b394408f646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a02267252fd44cae8fc91d1b7f2a72b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:39:42Z,use_quota=True,user_id='2445177af02342a5a86d3cdc1544d7a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ac6f7b7-0774-49c8-a626-05829c05f64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ac6f7b7-0774-49c8-a626-05829c05f64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b69af7e-0e52-489d-8270-d5c85b5a9559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b69af7e-0e52-489d-8270-d5c85b5a9559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efb937d5-f54b-4fce-bc72-6b394408f646', 'volume_name': 'volume-efb937d5-f54b-4fce-bc72-6b394408f646', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ef4f53e-7828-4b5d-bd6b-83e586337e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ef4f53e-7828-4b5d-bd6b-83e586337e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22ac7c9-5183-44ec-804d-9982839a8886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:41 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] Volume efb937d5-f54b-4fce-bc72-6b394408f646: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efb937d5-f54b-4fce-bc72-6b394408f646', 'volume_size': 1} Nov 02 15:39:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:41 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4b4743d-7867-420d-a9b8-b437e81cf74b -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b.d6ee9ad4-9a1f-405f-ac0e-9f4dec82e2bc" returned: 0 in 0.333s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:41 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b.d6ee9ad4-9a1f-405f-ac0e-9f4dec82e2bc is being set with open permissions: ugo+rw: NotImplementedError Nov 02 15:39:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b.d6ee9ad4-9a1f-405f-ac0e-9f4dec82e2bc {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:41 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b.d6ee9ad4-9a1f-405f-ac0e-9f4dec82e2bc Nov 02 15:39:41 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:41 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b.d6ee9ad4-9a1f-405f-ac0e-9f4dec82e2bc" returned: 0 in 0.276s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:42 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b.info Nov 02 15:39:42 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:42 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b.info" returned: 0 in 0.280s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:42 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 15:39:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:42 devstack sudo[99668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b.info Nov 02 15:39:42 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:42 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b.info" returned: 0 in 0.284s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.193s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.194s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:42 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1987352314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24981403-eeae-4765-b2d4-57d58eef158a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='266e5275824b410fa3ff472fbab7622b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:39:38Z,use_quota=True,user_id='efef85dd59fb4d24bddc0237a51f6aa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:39:42 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Creating volume 24981403-eeae-4765-b2d4-57d58eef158a {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:39:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:42 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:39:42 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:39:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:42 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:39:42 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:39:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:42 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a 1073741824 Nov 02 15:39:42 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:42 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-5079d615-3ba6-4776-a2f8-317b02bc7f07 tempest-GroupSnapshotsTest-2041888239 None] group_snapshot 1b221e21-163d-4a0b-89b8-d8c9d501f3b4: created successfully Nov 02 15:39:43 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a 1073741824" returned: 0 in 0.454s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:43 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a Nov 02 15:39:43 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:43 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a" returned: 0 in 0.271s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:39:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.695s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1860776906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efb937d5-f54b-4fce-bc72-6b394408f646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a02267252fd44cae8fc91d1b7f2a72b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:39:42Z,use_quota=True,user_id='2445177af02342a5a86d3cdc1544d7a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:39:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] Creating volume efb937d5-f54b-4fce-bc72-6b394408f646 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:39:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:39:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:39:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:39:43 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:39:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-efb937d5-f54b-4fce-bc72-6b394408f646 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:43 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d2a97f-4681-4d7c-a6d3-1b43ce932957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24981403-eeae-4765-b2d4-57d58eef158a', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:43 devstack sudo[99680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-efb937d5-f54b-4fce-bc72-6b394408f646 1073741824 Nov 02 15:39:43 devstack sudo[99680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:43 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (842a7170-c9e5-42a0-8b58-0261183a6f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:43 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Volume volume-24981403-eeae-4765-b2d4-57d58eef158a (24981403-eeae-4765-b2d4-57d58eef158a): created successfully Nov 02 15:39:43 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (842a7170-c9e5-42a0-8b58-0261183a6f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:43 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Flow 'volume_create_manager' (52a3f6f6-2b57-4ed8-ab9b-04f01464a342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:39:43 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-78d639fc-df38-4630-9384-7010699c90d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Created volume successfully. Nov 02 15:39:43 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] group_snapshot 1b221e21-163d-4a0b-89b8-d8c9d501f3b4: deleting Nov 02 15:39:43 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] group_snapshot 1b221e21-163d-4a0b-89b8-d8c9d501f3b4: deleting {{(pid=86703) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 15:39:43 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "cinder-quobyte-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:39:43 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] Lock "cinder-quobyte-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:39:43 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "cinder-quobyte-d4e0f4b9-f886-4b30-98fc-1a698b68993e" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:39:43 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] Lock "cinder-quobyte-d4e0f4b9-f886-4b30-98fc-1a698b68993e" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:39:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] Deleting offline snapshot d4e0f4b9-f886-4b30-98fc-1a698b68993e of volume a6d660d5-45e8-42bb-88ec-e4a2d125e8dd {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:39:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] snapshot_file for this snap is: volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd.d4e0f4b9-f886-4b30-98fc-1a698b68993e {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:39:43 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9929d6cd-9ea0-4eda-ad21-9474bc3cb517]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:39:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd.d4e0f4b9-f886-4b30-98fc-1a698b68993e {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:44 devstack sudo[99680]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-efb937d5-f54b-4fce-bc72-6b394408f646 1073741824" returned: 0 in 0.656s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7f17d4fc-1797-474d-b5d8-baf5b59a8ec1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-efb937d5-f54b-4fce-bc72-6b394408f646 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:44 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-efb937d5-f54b-4fce-bc72-6b394408f646 Nov 02 15:39:44 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:44 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd.d4e0f4b9-f886-4b30-98fc-1a698b68993e Nov 02 15:39:44 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:44 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-efb937d5-f54b-4fce-bc72-6b394408f646" returned: 0 in 0.320s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:44 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:39:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7f17d4fc-1797-474d-b5d8-baf5b59a8ec1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.368s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d22ac7c9-5183-44ec-804d-9982839a8886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efb937d5-f54b-4fce-bc72-6b394408f646', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (904aecb3-e6d9-4484-bc05-d6931bcade80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:44 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-7f17d4fc-1797-474d-b5d8-baf5b59a8ec1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Creating offline snapshot 1a7577d5-b30e-417f-87bd-5968a8711677 of volume 24981403-eeae-4765-b2d4-57d58eef158a {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:39:44 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4884b538-8675-4c28-8281-85845a65ae38]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:39:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7f17d4fc-1797-474d-b5d8-baf5b59a8ec1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:44 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] Volume volume-efb937d5-f54b-4fce-bc72-6b394408f646 (efb937d5-f54b-4fce-bc72-6b394408f646): created successfully Nov 02 15:39:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (904aecb3-e6d9-4484-bc05-d6931bcade80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:44 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] Flow 'volume_create_manager' (b4fbd000-a7d9-47e9-9358-8817b8f0750c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:39:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd.d4e0f4b9-f886-4b30-98fc-1a698b68993e" returned: 0 in 0.570s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:44 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:39:44 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74c7474-8eb6-4456-84dd-84a147120a88]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:39:44 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-eda1d406-486e-491a-a960-6109bf786975 tempest-VolumesTransfersTest-541135329 None] Created volume successfully. Nov 02 15:39:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:44 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a Nov 02 15:39:44 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:44 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd Nov 02 15:39:44 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:45 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7f17d4fc-1797-474d-b5d8-baf5b59a8ec1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a" returned: 0 in 0.546s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7f17d4fc-1797-474d-b5d8-baf5b59a8ec1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a.1a7577d5-b30e-417f-87bd-5968a8711677 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:45 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd" returned: 0 in 0.458s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd.d4e0f4b9-f886-4b30-98fc-1a698b68993e {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:45 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a.1a7577d5-b30e-417f-87bd-5968a8711677 1G Nov 02 15:39:45 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:45 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd.d4e0f4b9-f886-4b30-98fc-1a698b68993e Nov 02 15:39:45 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-49068bcf-f6b5-400c-96e4-de18d544a7dc tempest-VolumesTransfersTest-842130971 None] Acquiring lock "cinder-efb937d5-f54b-4fce-bc72-6b394408f646-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:39:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-49068bcf-f6b5-400c-96e4-de18d544a7dc tempest-VolumesTransfersTest-842130971 None] Lock "cinder-efb937d5-f54b-4fce-bc72-6b394408f646-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:39:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-49068bcf-f6b5-400c-96e4-de18d544a7dc tempest-VolumesTransfersTest-842130971 None] Acquiring lock "cinder-quobyte-efb937d5-f54b-4fce-bc72-6b394408f646" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:39:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-49068bcf-f6b5-400c-96e4-de18d544a7dc tempest-VolumesTransfersTest-842130971 None] Lock "cinder-quobyte-efb937d5-f54b-4fce-bc72-6b394408f646" acquired by "delete_volume" :: waited 0.033s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:39:45 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae8cdcd-9c8b-476f-8d51-913c047523c2]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:39:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-49068bcf-f6b5-400c-96e4-de18d544a7dc tempest-VolumesTransfersTest-842130971 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-efb937d5-f54b-4fce-bc72-6b394408f646 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:45 devstack sudo[99707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-efb937d5-f54b-4fce-bc72-6b394408f646 Nov 02 15:39:45 devstack sudo[99707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:45 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd.d4e0f4b9-f886-4b30-98fc-1a698b68993e" returned: 0 in 0.486s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd.d4e0f4b9-f886-4b30-98fc-1a698b68993e {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:45 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:45 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd.d4e0f4b9-f886-4b30-98fc-1a698b68993e Nov 02 15:39:45 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7f17d4fc-1797-474d-b5d8-baf5b59a8ec1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a.1a7577d5-b30e-417f-87bd-5968a8711677 1G" returned: 0 in 0.539s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7f17d4fc-1797-474d-b5d8-baf5b59a8ec1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24981403-eeae-4765-b2d4-57d58eef158a -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a.1a7577d5-b30e-417f-87bd-5968a8711677 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:45 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24981403-eeae-4765-b2d4-57d58eef158a -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a.1a7577d5-b30e-417f-87bd-5968a8711677 Nov 02 15:39:45 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:45 devstack sudo[99707]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-49068bcf-f6b5-400c-96e4-de18d544a7dc tempest-VolumesTransfersTest-842130971 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-efb937d5-f54b-4fce-bc72-6b394408f646" returned: 0 in 0.459s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-49068bcf-f6b5-400c-96e4-de18d544a7dc tempest-VolumesTransfersTest-842130971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-efb937d5-f54b-4fce-bc72-6b394408f646 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:45 devstack sudo[99727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-efb937d5-f54b-4fce-bc72-6b394408f646 Nov 02 15:39:45 devstack sudo[99727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:45 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd.d4e0f4b9-f886-4b30-98fc-1a698b68993e" returned: 0 in 0.303s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] Lock "cinder-quobyte-d4e0f4b9-f886-4b30-98fc-1a698b68993e" released by "_delete_snapshot" :: held 1.982s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:39:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] Lock "cinder-quobyte-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd" released by "delete_snapshot" :: held 2.031s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:39:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "cinder-quobyte-a4b4743d-7867-420d-a9b8-b437e81cf74b" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:39:45 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7f17d4fc-1797-474d-b5d8-baf5b59a8ec1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24981403-eeae-4765-b2d4-57d58eef158a -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a.1a7577d5-b30e-417f-87bd-5968a8711677" returned: 0 in 0.361s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:45 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-7f17d4fc-1797-474d-b5d8-baf5b59a8ec1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a.1a7577d5-b30e-417f-87bd-5968a8711677 is being set with open permissions: ugo+rw Nov 02 15:39:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7f17d4fc-1797-474d-b5d8-baf5b59a8ec1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a.1a7577d5-b30e-417f-87bd-5968a8711677 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] Lock "cinder-quobyte-a4b4743d-7867-420d-a9b8-b437e81cf74b" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:39:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "cinder-quobyte-d6ee9ad4-9a1f-405f-ac0e-9f4dec82e2bc" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:39:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] Lock "cinder-quobyte-d6ee9ad4-9a1f-405f-ac0e-9f4dec82e2bc" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:39:45 devstack sudo[99734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a.1a7577d5-b30e-417f-87bd-5968a8711677 Nov 02 15:39:45 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:45 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] Deleting offline snapshot d6ee9ad4-9a1f-405f-ac0e-9f4dec82e2bc of volume a4b4743d-7867-420d-a9b8-b437e81cf74b {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:39:46 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] snapshot_file for this snap is: volume-a4b4743d-7867-420d-a9b8-b437e81cf74b.d6ee9ad4-9a1f-405f-ac0e-9f4dec82e2bc {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:39:46 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c685a29-f5d8-4ec8-94c2-576df8c2ac9d]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:39:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b.d6ee9ad4-9a1f-405f-ac0e-9f4dec82e2bc {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:46 devstack sudo[99727]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-49068bcf-f6b5-400c-96e4-de18d544a7dc tempest-VolumesTransfersTest-842130971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-efb937d5-f54b-4fce-bc72-6b394408f646" returned: 0 in 0.318s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:46 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-49068bcf-f6b5-400c-96e4-de18d544a7dc tempest-VolumesTransfersTest-842130971 None] Lock "cinder-quobyte-efb937d5-f54b-4fce-bc72-6b394408f646" released by "delete_volume" :: held 0.863s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:39:46 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b.d6ee9ad4-9a1f-405f-ac0e-9f4dec82e2bc Nov 02 15:39:46 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:46 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-49068bcf-f6b5-400c-96e4-de18d544a7dc tempest-VolumesTransfersTest-842130971 None] Created reservations ['404ace6b-d807-4cd4-bae9-25dfcad1a41a', '00059fb1-7679-477b-8da6-a1c9480d2028', '5537bf2a-2611-4493-be57-5525a647beb4', 'a85667b2-2855-446a-9a3d-a425c8956fe2'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:39:46 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7f17d4fc-1797-474d-b5d8-baf5b59a8ec1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a.1a7577d5-b30e-417f-87bd-5968a8711677" returned: 0 in 0.351s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-49068bcf-f6b5-400c-96e4-de18d544a7dc tempest-VolumesTransfersTest-842130971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-49068bcf-f6b5-400c-96e4-de18d544a7dc tempest-VolumesTransfersTest-842130971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:46 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-49068bcf-f6b5-400c-96e4-de18d544a7dc tempest-VolumesTransfersTest-842130971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:39:46 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-49068bcf-f6b5-400c-96e4-de18d544a7dc tempest-VolumesTransfersTest-842130971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:39:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-49068bcf-f6b5-400c-96e4-de18d544a7dc tempest-VolumesTransfersTest-842130971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-49068bcf-f6b5-400c-96e4-de18d544a7dc tempest-VolumesTransfersTest-842130971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:46 devstack sudo[99740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:39:46 devstack sudo[99740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7f17d4fc-1797-474d-b5d8-baf5b59a8ec1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:46 devstack sudo[99742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a.info Nov 02 15:39:46 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:46 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b.d6ee9ad4-9a1f-405f-ac0e-9f4dec82e2bc" returned: 0 in 0.568s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:46 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4b4743d-7867-420d-a9b8-b437e81cf74b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:39:46 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d63e481-0bb9-4df1-9a72-ca866dc5c63a]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:39:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:46 devstack sudo[99740]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-49068bcf-f6b5-400c-96e4-de18d544a7dc tempest-VolumesTransfersTest-842130971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.359s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:46 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-49068bcf-f6b5-400c-96e4-de18d544a7dc tempest-VolumesTransfersTest-842130971 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:39:46 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-49068bcf-f6b5-400c-96e4-de18d544a7dc tempest-VolumesTransfersTest-842130971 None] Deleted volume successfully. Nov 02 15:39:46 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-49068bcf-f6b5-400c-96e4-de18d544a7dc tempest-VolumesTransfersTest-842130971 None] Lock "cinder-efb937d5-f54b-4fce-bc72-6b394408f646-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:39:46 devstack sudo[99748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b Nov 02 15:39:46 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:46 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7f17d4fc-1797-474d-b5d8-baf5b59a8ec1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a.info" returned: 0 in 0.448s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:46 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-7f17d4fc-1797-474d-b5d8-baf5b59a8ec1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a.info is being set with open permissions: ugo+rw Nov 02 15:39:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7f17d4fc-1797-474d-b5d8-baf5b59a8ec1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:46 devstack sudo[99751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a.info Nov 02 15:39:46 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:47 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7f17d4fc-1797-474d-b5d8-baf5b59a8ec1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a.info" returned: 0 in 0.326s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:47 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7f17d4fc-1797-474d-b5d8-baf5b59a8ec1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.787s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b" returned: 0 in 0.555s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b.d6ee9ad4-9a1f-405f-ac0e-9f4dec82e2bc {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:47 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-7f17d4fc-1797-474d-b5d8-baf5b59a8ec1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Create snapshot completed successfully Nov 02 15:39:47 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b.d6ee9ad4-9a1f-405f-ac0e-9f4dec82e2bc Nov 02 15:39:47 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:47 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b.d6ee9ad4-9a1f-405f-ac0e-9f4dec82e2bc" returned: 0 in 0.438s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b.d6ee9ad4-9a1f-405f-ac0e-9f4dec82e2bc {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:47 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b.d6ee9ad4-9a1f-405f-ac0e-9f4dec82e2bc Nov 02 15:39:47 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:47 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b.d6ee9ad4-9a1f-405f-ac0e-9f4dec82e2bc" returned: 0 in 0.257s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:47 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] Lock "cinder-quobyte-d6ee9ad4-9a1f-405f-ac0e-9f4dec82e2bc" released by "_delete_snapshot" :: held 1.959s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:39:47 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] Lock "cinder-quobyte-a4b4743d-7867-420d-a9b8-b437e81cf74b" released by "delete_snapshot" :: held 1.996s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:39:48 devstack cinder-volume[86703]: WARNING cinder.quota [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-920266543 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-920266543, it is now deprecated. Please use the default quota class for default quota. Nov 02 15:39:48 devstack cinder-volume[86703]: WARNING cinder.quota [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-920266543 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-920266543, it is now deprecated. Please use the default quota class for default quota. Nov 02 15:39:48 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] Created reservations ['63372cb6-e7eb-4d9b-9222-c5476f3a9aa4', 'cf6473c8-4389-4a07-9812-9050eb1b4683', 'ac2610a6-3d37-489e-ae53-267f855607c1', '4455ea28-0872-45b9-96a2-012ea11a2a36'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:39:48 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] Created reservations ['9fba2d05-ba0f-4bf9-8012-0a5bc6d4d2b1', 'e2412889-3fa1-44f5-bf91-deaecb892312', 'e4d95b4c-0b69-4359-acae-a831bced5f26', '9aeebd4d-fcfe-440d-a5be-f2606b40dfb3'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:39:48 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-138b97d5-bf2e-49c8-892e-d4024faf622f tempest-GroupSnapshotsTest-2041888239 None] group_snapshot 1b221e21-163d-4a0b-89b8-d8c9d501f3b4: deleted successfully Nov 02 15:39:48 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ab22ec22-0ee7-4ce2-b10c-c538c9fdc2d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Acquiring lock "cinder-1a7577d5-b30e-417f-87bd-5968a8711677-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:39:48 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ab22ec22-0ee7-4ce2-b10c-c538c9fdc2d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Lock "cinder-1a7577d5-b30e-417f-87bd-5968a8711677-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:39:48 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ab22ec22-0ee7-4ce2-b10c-c538c9fdc2d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Acquiring lock "cinder-quobyte-24981403-eeae-4765-b2d4-57d58eef158a" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:39:48 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ab22ec22-0ee7-4ce2-b10c-c538c9fdc2d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Lock "cinder-quobyte-24981403-eeae-4765-b2d4-57d58eef158a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:39:48 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ab22ec22-0ee7-4ce2-b10c-c538c9fdc2d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Acquiring lock "cinder-quobyte-1a7577d5-b30e-417f-87bd-5968a8711677" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:39:48 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ab22ec22-0ee7-4ce2-b10c-c538c9fdc2d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Lock "cinder-quobyte-1a7577d5-b30e-417f-87bd-5968a8711677" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:39:48 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-ab22ec22-0ee7-4ce2-b10c-c538c9fdc2d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Deleting offline snapshot 1a7577d5-b30e-417f-87bd-5968a8711677 of volume 24981403-eeae-4765-b2d4-57d58eef158a {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:39:48 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-ab22ec22-0ee7-4ce2-b10c-c538c9fdc2d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] snapshot_file for this snap is: volume-24981403-eeae-4765-b2d4-57d58eef158a.1a7577d5-b30e-417f-87bd-5968a8711677 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:39:48 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ff5905-5387-4b44-b7c4-95f7cd32b75b]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:39:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ab22ec22-0ee7-4ce2-b10c-c538c9fdc2d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a.1a7577d5-b30e-417f-87bd-5968a8711677 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:49 devstack sudo[99769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a.1a7577d5-b30e-417f-87bd-5968a8711677 Nov 02 15:39:49 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:49 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ee7bee02-8ec8-497c-8c8e-8dcfc9996a4f tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "cinder-quobyte-a4b4743d-7867-420d-a9b8-b437e81cf74b" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:39:49 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ee7bee02-8ec8-497c-8c8e-8dcfc9996a4f tempest-GroupSnapshotsTest-2041888239 None] Lock "cinder-quobyte-a4b4743d-7867-420d-a9b8-b437e81cf74b" acquired by "delete_volume" :: waited 0.027s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:39:49 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c948de1e-79f9-44b5-9954-c45448199e9c]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:39:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ee7bee02-8ec8-497c-8c8e-8dcfc9996a4f tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:49 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ab22ec22-0ee7-4ce2-b10c-c538c9fdc2d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a.1a7577d5-b30e-417f-87bd-5968a8711677" returned: 0 in 0.573s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-ab22ec22-0ee7-4ce2-b10c-c538c9fdc2d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24981403-eeae-4765-b2d4-57d58eef158a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:39:49 devstack sudo[99774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b Nov 02 15:39:49 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:49 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d92e92-6e3d-4a0f-8810-012b5196470b]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:39:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ab22ec22-0ee7-4ce2-b10c-c538c9fdc2d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:49 devstack sudo[99777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a Nov 02 15:39:49 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:49 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ee7bee02-8ec8-497c-8c8e-8dcfc9996a4f tempest-GroupSnapshotsTest-2041888239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b" returned: 0 in 0.578s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ee7bee02-8ec8-497c-8c8e-8dcfc9996a4f tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:49 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b Nov 02 15:39:49 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:50 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ab22ec22-0ee7-4ce2-b10c-c538c9fdc2d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a" returned: 0 in 0.539s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ab22ec22-0ee7-4ce2-b10c-c538c9fdc2d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a.1a7577d5-b30e-417f-87bd-5968a8711677 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:50 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a.1a7577d5-b30e-417f-87bd-5968a8711677 Nov 02 15:39:50 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-23b5674e-1e59-4acf-b410-04ad4fdc2b24 req-323e6a62-3d38-4a9a-baa7-1a9f95858532 tempest-TestStampPattern-141219102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-23b5674e-1e59-4acf-b410-04ad4fdc2b24 req-323e6a62-3d38-4a9a-baa7-1a9f95858532 tempest-TestStampPattern-141219102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-23b5674e-1e59-4acf-b410-04ad4fdc2b24 req-323e6a62-3d38-4a9a-baa7-1a9f95858532 tempest-TestStampPattern-141219102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-23b5674e-1e59-4acf-b410-04ad4fdc2b24 req-323e6a62-3d38-4a9a-baa7-1a9f95858532 tempest-TestStampPattern-141219102 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478', 'name': 'volume-9ea481b8-1e1d-4d7c-aebe-47ce449c4544', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '44c9e90b-3968-4220-939e-35119b2cff15', 'enforce_multipath': True} {{(pid=86703) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 15:39:50 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ee7bee02-8ec8-497c-8c8e-8dcfc9996a4f tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a4b4743d-7867-420d-a9b8-b437e81cf74b" returned: 0 in 0.340s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:50 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ee7bee02-8ec8-497c-8c8e-8dcfc9996a4f tempest-GroupSnapshotsTest-2041888239 None] Lock "cinder-quobyte-a4b4743d-7867-420d-a9b8-b437e81cf74b" released by "delete_volume" :: held 1.052s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:39:50 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ee7bee02-8ec8-497c-8c8e-8dcfc9996a4f tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "cinder-quobyte-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:39:50 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-23b5674e-1e59-4acf-b410-04ad4fdc2b24 req-323e6a62-3d38-4a9a-baa7-1a9f95858532 tempest-TestStampPattern-141219102 None] attachment_update completed successfully. Nov 02 15:39:50 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ee7bee02-8ec8-497c-8c8e-8dcfc9996a4f tempest-GroupSnapshotsTest-2041888239 None] Lock "cinder-quobyte-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd" acquired by "delete_volume" :: waited 0.029s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:39:50 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e904fe35-ea44-4dda-b1dc-dc17aa9c8fe9]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:39:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ee7bee02-8ec8-497c-8c8e-8dcfc9996a4f tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:50 devstack sudo[99800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd Nov 02 15:39:50 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:50 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ab22ec22-0ee7-4ce2-b10c-c538c9fdc2d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a.1a7577d5-b30e-417f-87bd-5968a8711677" returned: 0 in 0.584s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ab22ec22-0ee7-4ce2-b10c-c538c9fdc2d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a.1a7577d5-b30e-417f-87bd-5968a8711677 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:50 devstack sudo[99899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a.1a7577d5-b30e-417f-87bd-5968a8711677 Nov 02 15:39:50 devstack sudo[99899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:51 devstack sudo[99899]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ab22ec22-0ee7-4ce2-b10c-c538c9fdc2d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a.1a7577d5-b30e-417f-87bd-5968a8711677" returned: 0 in 0.338s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:51 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ab22ec22-0ee7-4ce2-b10c-c538c9fdc2d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Lock "cinder-quobyte-1a7577d5-b30e-417f-87bd-5968a8711677" released by "_delete_snapshot" :: held 2.212s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:39:51 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ab22ec22-0ee7-4ce2-b10c-c538c9fdc2d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Lock "cinder-quobyte-24981403-eeae-4765-b2d4-57d58eef158a" released by "delete_snapshot" :: held 2.244s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:39:51 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ee7bee02-8ec8-497c-8c8e-8dcfc9996a4f tempest-GroupSnapshotsTest-2041888239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd" returned: 0 in 0.664s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ee7bee02-8ec8-497c-8c8e-8dcfc9996a4f tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:51 devstack sudo[100224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd Nov 02 15:39:51 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:51 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-ab22ec22-0ee7-4ce2-b10c-c538c9fdc2d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Created reservations ['a95f3b9a-c050-4189-b067-144917cb351a', '29a1d5ee-95e2-45d8-86e7-596ddea45167', 'b7db1e5b-4ba3-4c48-b332-574b8de4a13e', '5472c427-2425-4b47-b331-13a810d55f4f'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:39:51 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-ab22ec22-0ee7-4ce2-b10c-c538c9fdc2d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Delete snapshot completed successfully. Nov 02 15:39:51 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ab22ec22-0ee7-4ce2-b10c-c538c9fdc2d7 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Lock "cinder-1a7577d5-b30e-417f-87bd-5968a8711677-delete_snapshot" released by "delete_snapshot" :: held 2.526s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:39:51 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ee7bee02-8ec8-497c-8c8e-8dcfc9996a4f tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd" returned: 0 in 0.348s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:51 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ee7bee02-8ec8-497c-8c8e-8dcfc9996a4f tempest-GroupSnapshotsTest-2041888239 None] Lock "cinder-quobyte-a6d660d5-45e8-42bb-88ec-e4a2d125e8dd" released by "delete_volume" :: held 1.114s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:39:51 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-ee7bee02-8ec8-497c-8c8e-8dcfc9996a4f tempest-GroupSnapshotsTest-2041888239 None] Created reservations ['c6f8d2c0-42f8-4750-a65a-22fc76a1824e'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:39:51 devstack cinder-volume[86703]: WARNING cinder.quota [None req-ee7bee02-8ec8-497c-8c8e-8dcfc9996a4f tempest-GroupSnapshotsTest-2041888239 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-920266543 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-920266543, it is now deprecated. Please use the default quota class for default quota. Nov 02 15:39:51 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-ee7bee02-8ec8-497c-8c8e-8dcfc9996a4f tempest-GroupSnapshotsTest-2041888239 None] Created reservations ['36853b95-eea2-4153-a3fa-d3c2ac3f4ee0', '37a1794f-b792-4baf-81e4-84147501e84c', '73d9f192-2963-4d05-a037-786508526d41', '99b8b0ee-99ac-4adc-82df-c3f10103a874'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:39:51 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-ee7bee02-8ec8-497c-8c8e-8dcfc9996a4f tempest-GroupSnapshotsTest-2041888239 None] Created reservations ['cd4df1cf-4370-4b63-966b-b50a8017bdb5', 'ee6504cb-018a-42b3-b34d-2f082f3f1aa1', 'e2ce58a0-3735-46d5-b1fa-5b1e5d24fbd5', '1132df52-76de-4a39-8fbe-4a304507e0c5'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:39:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ee7bee02-8ec8-497c-8c8e-8dcfc9996a4f tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ee7bee02-8ec8-497c-8c8e-8dcfc9996a4f tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:51 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ee7bee02-8ec8-497c-8c8e-8dcfc9996a4f tempest-GroupSnapshotsTest-2041888239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:39:51 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ee7bee02-8ec8-497c-8c8e-8dcfc9996a4f tempest-GroupSnapshotsTest-2041888239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:39:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ee7bee02-8ec8-497c-8c8e-8dcfc9996a4f tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ee7bee02-8ec8-497c-8c8e-8dcfc9996a4f tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:51 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:39:51 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:52 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:52 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-78f6e0c9-f157-457d-bfb6-02f9fb0ae165 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Acquiring lock "cinder-24981403-eeae-4765-b2d4-57d58eef158a-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:39:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ee7bee02-8ec8-497c-8c8e-8dcfc9996a4f tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.330s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:52 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-ee7bee02-8ec8-497c-8c8e-8dcfc9996a4f tempest-GroupSnapshotsTest-2041888239 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:39:52 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-ee7bee02-8ec8-497c-8c8e-8dcfc9996a4f tempest-GroupSnapshotsTest-2041888239 None] Delete group completed successfully. Nov 02 15:39:52 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-78f6e0c9-f157-457d-bfb6-02f9fb0ae165 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Lock "cinder-24981403-eeae-4765-b2d4-57d58eef158a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:39:52 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-78f6e0c9-f157-457d-bfb6-02f9fb0ae165 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Acquiring lock "cinder-quobyte-24981403-eeae-4765-b2d4-57d58eef158a" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:39:52 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-78f6e0c9-f157-457d-bfb6-02f9fb0ae165 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Lock "cinder-quobyte-24981403-eeae-4765-b2d4-57d58eef158a" acquired by "delete_volume" :: waited 0.021s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:39:52 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d0000f-395c-4ae5-ba34-3b55bae1b85a]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:39:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-78f6e0c9-f157-457d-bfb6-02f9fb0ae165 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:52 devstack sudo[100234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a Nov 02 15:39:52 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:52 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-78f6e0c9-f157-457d-bfb6-02f9fb0ae165 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a" returned: 0 in 0.463s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-78f6e0c9-f157-457d-bfb6-02f9fb0ae165 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:52 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a Nov 02 15:39:52 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:53 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-78f6e0c9-f157-457d-bfb6-02f9fb0ae165 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24981403-eeae-4765-b2d4-57d58eef158a" returned: 0 in 0.303s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:53 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-78f6e0c9-f157-457d-bfb6-02f9fb0ae165 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Lock "cinder-quobyte-24981403-eeae-4765-b2d4-57d58eef158a" released by "delete_volume" :: held 0.865s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:39:53 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-78f6e0c9-f157-457d-bfb6-02f9fb0ae165 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Created reservations ['60f85e01-3355-44fb-a0f4-1215dae5becd', '02266b63-5bac-4f00-99b0-835dccd4cf8b', 'c40df8e3-ad74-4057-8041-287ec79564a5', 'a2b10c9a-a89b-420e-be31-4ab02b19152f'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:39:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-78f6e0c9-f157-457d-bfb6-02f9fb0ae165 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-78f6e0c9-f157-457d-bfb6-02f9fb0ae165 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:53 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-78f6e0c9-f157-457d-bfb6-02f9fb0ae165 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:39:53 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-78f6e0c9-f157-457d-bfb6-02f9fb0ae165 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:39:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-78f6e0c9-f157-457d-bfb6-02f9fb0ae165 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-78f6e0c9-f157-457d-bfb6-02f9fb0ae165 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:53 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:39:53 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:53 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-7922dc39-20c2-4bc4-9632-7ff64f7378cc tempest-GroupSnapshotsTest-2041888239 None] Group tempest-GroupSnapshotsTest-Group-1602208626: creating Nov 02 15:39:53 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-7922dc39-20c2-4bc4-9632-7ff64f7378cc tempest-GroupSnapshotsTest-2041888239 None] Group tempest-GroupSnapshotsTest-Group-1602208626: created successfully Nov 02 15:39:53 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-7922dc39-20c2-4bc4-9632-7ff64f7378cc tempest-GroupSnapshotsTest-2041888239 None] Create group completed successfully. Nov 02 15:39:53 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-78f6e0c9-f157-457d-bfb6-02f9fb0ae165 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.395s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:53 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-78f6e0c9-f157-457d-bfb6-02f9fb0ae165 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:39:53 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-78f6e0c9-f157-457d-bfb6-02f9fb0ae165 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Deleted volume successfully. Nov 02 15:39:53 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-78f6e0c9-f157-457d-bfb6-02f9fb0ae165 tempest-VolumeSnapshotQuotasNegativeTestJSON-1195561754 None] Lock "cinder-24981403-eeae-4765-b2d4-57d58eef158a-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:39:54 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-2ae6ab86-2110-4940-b1af-0133d5d1ce8a req-3d5145dc-f86c-420c-b6b9-0580f36d068e tempest-TestStampPattern-141219102 None] Terminate volume connection completed successfully. Nov 02 15:39:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-2ae6ab86-2110-4940-b1af-0133d5d1ce8a req-3d5145dc-f86c-420c-b6b9-0580f36d068e tempest-TestStampPattern-141219102 None] Deleting attachment 44c9e90b-3968-4220-939e-35119b2cff15. {{(pid=86703) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 15:39:55 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:39:55 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] Flow 'volume_create_manager' (40171a7d-7002-463b-848d-eda497417734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:39:55 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed6eb32e-a50a-4070-9102-122385ae91a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:55 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed6eb32e-a50a-4070-9102-122385ae91a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-754085183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=509c155c-59d9-4476-bffe-c456020b47be,host='devstack@QuobyteHD#QuobyteHD',id=d56ae6a2-3a1d-4471-8649-618073df5b09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad9598ccb614ffea3d47292cc4aa60d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:39:55Z,use_quota=True,user_id='73ff6941c0b043a392e5b56e97b46f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0d0b5cd-1d40-4513-96ae-4f226771c9c5),volume_type_id=a0d0b5cd-1d40-4513-96ae-4f226771c9c5)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:55 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (638b75bb-4d83-4bd7-816d-c440ca607a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:55 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (638b75bb-4d83-4bd7-816d-c440ca607a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:55 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3112d7f-aff8-456e-b81b-d3dfe13c8651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:55 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3112d7f-aff8-456e-b81b-d3dfe13c8651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd56ae6a2-3a1d-4471-8649-618073df5b09', 'volume_name': 'volume-d56ae6a2-3a1d-4471-8649-618073df5b09', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:55 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e778303-386f-4915-ac9e-188fc675ea97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:55 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e778303-386f-4915-ac9e-188fc675ea97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:55 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cadb580-60f2-4a3a-a3b1-b7873c2ca518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:55 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] Volume d56ae6a2-3a1d-4471-8649-618073df5b09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d56ae6a2-3a1d-4471-8649-618073df5b09', 'volume_size': 1} Nov 02 15:39:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:55 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=509c155c-59d9-4476-bffe-c456020b47be,created_at=2026-11-02T14:39:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-754085183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=509c155c-59d9-4476-bffe-c456020b47be,host='devstack@QuobyteHD#QuobyteHD',id=d56ae6a2-3a1d-4471-8649-618073df5b09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fad9598ccb614ffea3d47292cc4aa60d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:39:55Z,use_quota=True,user_id='73ff6941c0b043a392e5b56e97b46f8c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a0d0b5cd-1d40-4513-96ae-4f226771c9c5),volume_type_id=a0d0b5cd-1d40-4513-96ae-4f226771c9c5)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:39:55 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] Creating volume d56ae6a2-3a1d-4471-8649-618073df5b09 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:39:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:55 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:39:55 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:39:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:55 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:39:55 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:39:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:55 devstack sudo[100321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09 1073741824 Nov 02 15:39:55 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:56 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09 1073741824" returned: 0 in 0.732s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:56 devstack sudo[100328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09 Nov 02 15:39:56 devstack sudo[100328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:57 devstack sudo[100328]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09" returned: 0 in 0.602s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:39:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cadb580-60f2-4a3a-a3b1-b7873c2ca518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d56ae6a2-3a1d-4471-8649-618073df5b09', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f8ee4dd-fccd-4b64-94df-5ef4e4a18776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:57 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] Volume volume-d56ae6a2-3a1d-4471-8649-618073df5b09 (d56ae6a2-3a1d-4471-8649-618073df5b09): created successfully Nov 02 15:39:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f8ee4dd-fccd-4b64-94df-5ef4e4a18776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] Flow 'volume_create_manager' (40171a7d-7002-463b-848d-eda497417734) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:39:57 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-af622e87-93bc-49aa-b03e-3e52e3c6a406 tempest-GroupSnapshotsTest-2041888239 None] Created volume successfully. Nov 02 15:39:57 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:39:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] Flow 'volume_create_manager' (21ee8b81-2622-4d9e-b2ad-b737d781014b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:39:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bde043b-b71c-4f2b-b68d-250b04d43595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bde043b-b71c-4f2b-b68d-250b04d43595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-945287920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eee44a41-6284-4e0c-a1b3-cfee63f7b1d4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2adb4554439149c68a175b57ac2c4975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:39:57Z,use_quota=True,user_id='5564bfc2103649b385e14a1e5e7eac73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e3db633-7e2b-4854-acac-a6a0ef57fc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e3db633-7e2b-4854-acac-a6a0ef57fc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e746eaa-98af-44ce-a24b-20860ad7b426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e746eaa-98af-44ce-a24b-20860ad7b426) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eee44a41-6284-4e0c-a1b3-cfee63f7b1d4', 'volume_name': 'volume-eee44a41-6284-4e0c-a1b3-cfee63f7b1d4', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dbc0664-8fcb-46f1-80c6-e64360c84d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dbc0664-8fcb-46f1-80c6-e64360c84d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9221f0-7fc4-4c8d-8135-8bb179d42364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:57 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] Volume eee44a41-6284-4e0c-a1b3-cfee63f7b1d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eee44a41-6284-4e0c-a1b3-cfee63f7b1d4', 'volume_size': 1} Nov 02 15:39:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:39:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-945287920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eee44a41-6284-4e0c-a1b3-cfee63f7b1d4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2adb4554439149c68a175b57ac2c4975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:39:57Z,use_quota=True,user_id='5564bfc2103649b385e14a1e5e7eac73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:39:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] Creating volume eee44a41-6284-4e0c-a1b3-cfee63f7b1d4 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:39:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:39:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:39:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:39:57 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:39:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-eee44a41-6284-4e0c-a1b3-cfee63f7b1d4 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:57 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-eee44a41-6284-4e0c-a1b3-cfee63f7b1d4 1073741824 Nov 02 15:39:57 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:58 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-eee44a41-6284-4e0c-a1b3-cfee63f7b1d4 1073741824" returned: 0 in 0.671s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-eee44a41-6284-4e0c-a1b3-cfee63f7b1d4 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:58 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-eee44a41-6284-4e0c-a1b3-cfee63f7b1d4 Nov 02 15:39:58 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:58 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-eee44a41-6284-4e0c-a1b3-cfee63f7b1d4" returned: 0 in 0.462s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:58 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:39:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.246s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:39:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a9221f0-7fc4-4c8d-8135-8bb179d42364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eee44a41-6284-4e0c-a1b3-cfee63f7b1d4', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74fb3734-130f-4335-ab90-bab3c807bc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:39:58 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-cbbae840-48f0-4e42-9b7a-3914fb95148e tempest-GroupSnapshotsTest-2041888239 None] GroupSnapshot 0cff5bc6-56b6-4d87-ad4b-da2aad601091: creating. Nov 02 15:39:58 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] Volume volume-eee44a41-6284-4e0c-a1b3-cfee63f7b1d4 (eee44a41-6284-4e0c-a1b3-cfee63f7b1d4): created successfully Nov 02 15:39:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74fb3734-130f-4335-ab90-bab3c807bc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:39:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] Flow 'volume_create_manager' (21ee8b81-2622-4d9e-b2ad-b737d781014b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:39:58 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-63fe6f8a-7b1d-4565-a964-f4506b3aa71e tempest-VolumesListTestJSON-660949084 None] Created volume successfully. Nov 02 15:39:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cbbae840-48f0-4e42-9b7a-3914fb95148e tempest-GroupSnapshotsTest-2041888239 None] Group snapshot 0cff5bc6-56b6-4d87-ad4b-da2aad601091: creating. {{(pid=86703) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 02 15:39:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-cbbae840-48f0-4e42-9b7a-3914fb95148e tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:39:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-cbbae840-48f0-4e42-9b7a-3914fb95148e tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:39:58 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-cbbae840-48f0-4e42-9b7a-3914fb95148e tempest-GroupSnapshotsTest-2041888239 None] Creating offline snapshot 406c3440-cef7-4373-ab06-79bfd9372fea of volume d56ae6a2-3a1d-4471-8649-618073df5b09 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:39:58 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[739c4f1d-e518-400a-9b77-e8675114eec8]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:39:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cbbae840-48f0-4e42-9b7a-3914fb95148e tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:58 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09 Nov 02 15:39:58 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:59 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cbbae840-48f0-4e42-9b7a-3914fb95148e tempest-GroupSnapshotsTest-2041888239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09" returned: 0 in 0.433s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cbbae840-48f0-4e42-9b7a-3914fb95148e tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09.406c3440-cef7-4373-ab06-79bfd9372fea 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:59 devstack sudo[100368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09.406c3440-cef7-4373-ab06-79bfd9372fea 1G Nov 02 15:39:59 devstack sudo[100368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:59 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-63f274c9-7652-4178-b825-483b8222d233 tempest-TestStampPattern-141219102 None] Acquiring lock "cinder-9ea481b8-1e1d-4d7c-aebe-47ce449c4544-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:39:59 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-63f274c9-7652-4178-b825-483b8222d233 tempest-TestStampPattern-141219102 None] Lock "cinder-9ea481b8-1e1d-4d7c-aebe-47ce449c4544-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:39:59 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-63f274c9-7652-4178-b825-483b8222d233 tempest-TestStampPattern-141219102 None] Acquiring lock "cinder-quobyte-9ea481b8-1e1d-4d7c-aebe-47ce449c4544" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:39:59 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-63f274c9-7652-4178-b825-483b8222d233 tempest-TestStampPattern-141219102 None] Lock "cinder-quobyte-9ea481b8-1e1d-4d7c-aebe-47ce449c4544" acquired by "delete_volume" :: waited 0.024s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:39:59 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cfe0ad-bd9a-439d-bbcf-baf732ba0266]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:39:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-63f274c9-7652-4178-b825-483b8222d233 tempest-TestStampPattern-141219102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9ea481b8-1e1d-4d7c-aebe-47ce449c4544 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:59 devstack sudo[100368]: pam_unix(sudo:session): session closed for user root Nov 02 15:39:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cbbae840-48f0-4e42-9b7a-3914fb95148e tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09.406c3440-cef7-4373-ab06-79bfd9372fea 1G" returned: 0 in 0.617s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:39:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cbbae840-48f0-4e42-9b7a-3914fb95148e tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d56ae6a2-3a1d-4471-8649-618073df5b09 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09.406c3440-cef7-4373-ab06-79bfd9372fea {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:39:59 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d56ae6a2-3a1d-4471-8649-618073df5b09 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09.406c3440-cef7-4373-ab06-79bfd9372fea Nov 02 15:39:59 devstack sudo[100374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9ea481b8-1e1d-4d7c-aebe-47ce449c4544 Nov 02 15:39:59 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:39:59 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:00 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:40:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] Flow 'volume_create_manager' (eaafae75-781e-4e25-9386-35b6f964b5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:40:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec1aafe6-a497-4561-baad-9c61c6e17594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec1aafe6-a497-4561-baad-9c61c6e17594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-390673772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd54f3aa-34e7-465e-9892-371b6293b737,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2adb4554439149c68a175b57ac2c4975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:40:00Z,use_quota=True,user_id='5564bfc2103649b385e14a1e5e7eac73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90330137-0f99-4f78-834a-24ac9f6db456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90330137-0f99-4f78-834a-24ac9f6db456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74dd8570-14ad-4f6a-baec-5d1ad8e00998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74dd8570-14ad-4f6a-baec-5d1ad8e00998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd54f3aa-34e7-465e-9892-371b6293b737', 'volume_name': 'volume-cd54f3aa-34e7-465e-9892-371b6293b737', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94adbf98-22a1-47c4-a359-bcb58f66f903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94adbf98-22a1-47c4-a359-bcb58f66f903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (510750c7-1a47-40bd-aa94-fc6441789562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:00 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] Volume cd54f3aa-34e7-465e-9892-371b6293b737: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd54f3aa-34e7-465e-9892-371b6293b737', 'volume_size': 1} Nov 02 15:40:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:40:00 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cbbae840-48f0-4e42-9b7a-3914fb95148e tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d56ae6a2-3a1d-4471-8649-618073df5b09 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09.406c3440-cef7-4373-ab06-79bfd9372fea" returned: 0 in 0.341s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:00 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-cbbae840-48f0-4e42-9b7a-3914fb95148e tempest-GroupSnapshotsTest-2041888239 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09.406c3440-cef7-4373-ab06-79bfd9372fea is being set with open permissions: ugo+rw: NotImplementedError Nov 02 15:40:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cbbae840-48f0-4e42-9b7a-3914fb95148e tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09.406c3440-cef7-4373-ab06-79bfd9372fea {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:00 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-63f274c9-7652-4178-b825-483b8222d233 tempest-TestStampPattern-141219102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9ea481b8-1e1d-4d7c-aebe-47ce449c4544" returned: 0 in 0.466s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-63f274c9-7652-4178-b825-483b8222d233 tempest-TestStampPattern-141219102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9ea481b8-1e1d-4d7c-aebe-47ce449c4544 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:00 devstack sudo[100386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09.406c3440-cef7-4373-ab06-79bfd9372fea Nov 02 15:40:00 devstack sudo[100386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:00 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9ea481b8-1e1d-4d7c-aebe-47ce449c4544 Nov 02 15:40:00 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:00 devstack sudo[100386]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cbbae840-48f0-4e42-9b7a-3914fb95148e tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09.406c3440-cef7-4373-ab06-79bfd9372fea" returned: 0 in 0.279s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:00 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cbbae840-48f0-4e42-9b7a-3914fb95148e tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-63f274c9-7652-4178-b825-483b8222d233 tempest-TestStampPattern-141219102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9ea481b8-1e1d-4d7c-aebe-47ce449c4544" returned: 0 in 0.299s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:00 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-63f274c9-7652-4178-b825-483b8222d233 tempest-TestStampPattern-141219102 None] Lock "cinder-quobyte-9ea481b8-1e1d-4d7c-aebe-47ce449c4544" released by "delete_volume" :: held 0.823s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:40:00 devstack sudo[100392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09.info Nov 02 15:40:00 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:00 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-63f274c9-7652-4178-b825-483b8222d233 tempest-TestStampPattern-141219102 None] Created reservations ['ba7a5206-f33f-400d-b867-d597b7aa0281', '7d0004fc-e82a-45f4-b845-c94d1b538cd1', 'd5b175c8-7161-4a8b-816d-0c1567737e71', '0c0b9e86-f387-4762-a058-3cc21209bae5'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:40:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-63f274c9-7652-4178-b825-483b8222d233 tempest-TestStampPattern-141219102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:40:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-63f274c9-7652-4178-b825-483b8222d233 tempest-TestStampPattern-141219102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:40:00 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-63f274c9-7652-4178-b825-483b8222d233 tempest-TestStampPattern-141219102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:40:00 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-63f274c9-7652-4178-b825-483b8222d233 tempest-TestStampPattern-141219102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:40:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-63f274c9-7652-4178-b825-483b8222d233 tempest-TestStampPattern-141219102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:40:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-63f274c9-7652-4178-b825-483b8222d233 tempest-TestStampPattern-141219102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:00 devstack sudo[100394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:40:00 devstack sudo[100394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:00 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cbbae840-48f0-4e42-9b7a-3914fb95148e tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09.info" returned: 0 in 0.362s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:00 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-cbbae840-48f0-4e42-9b7a-3914fb95148e tempest-GroupSnapshotsTest-2041888239 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09.info is being set with open permissions: ugo+rw: NotImplementedError Nov 02 15:40:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cbbae840-48f0-4e42-9b7a-3914fb95148e tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:00 devstack sudo[100397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09.info Nov 02 15:40:00 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:01 devstack sudo[100394]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-63f274c9-7652-4178-b825-483b8222d233 tempest-TestStampPattern-141219102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.351s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:01 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-63f274c9-7652-4178-b825-483b8222d233 tempest-TestStampPattern-141219102 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:40:01 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-63f274c9-7652-4178-b825-483b8222d233 tempest-TestStampPattern-141219102 None] Deleted volume successfully. Nov 02 15:40:01 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-63f274c9-7652-4178-b825-483b8222d233 tempest-TestStampPattern-141219102 None] Lock "cinder-9ea481b8-1e1d-4d7c-aebe-47ce449c4544-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:40:01 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:01 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-fe1f6c24-a6aa-4a53-a493-8af1b912d3ad tempest-TestStampPattern-141219102 None] Acquiring lock "cinder-4730852c-85d0-4a1c-9c53-fb9f37fcf6ec-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:40:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cbbae840-48f0-4e42-9b7a-3914fb95148e tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09.info" returned: 0 in 0.348s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-cbbae840-48f0-4e42-9b7a-3914fb95148e tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.492s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:40:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.145s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:40:01 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-390673772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd54f3aa-34e7-465e-9892-371b6293b737,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2adb4554439149c68a175b57ac2c4975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:40:00Z,use_quota=True,user_id='5564bfc2103649b385e14a1e5e7eac73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:40:01 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] Creating volume cd54f3aa-34e7-465e-9892-371b6293b737 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:40:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:40:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:40:01 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:40:01 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:40:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:40:01 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:40:01 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:40:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-cd54f3aa-34e7-465e-9892-371b6293b737 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:01 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-fe1f6c24-a6aa-4a53-a493-8af1b912d3ad tempest-TestStampPattern-141219102 None] Lock "cinder-4730852c-85d0-4a1c-9c53-fb9f37fcf6ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.089s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:40:01 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-cd54f3aa-34e7-465e-9892-371b6293b737 1073741824 Nov 02 15:40:01 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:01 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-fe1f6c24-a6aa-4a53-a493-8af1b912d3ad tempest-TestStampPattern-141219102 None] Acquiring lock "cinder-quobyte-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:40:01 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-fe1f6c24-a6aa-4a53-a493-8af1b912d3ad tempest-TestStampPattern-141219102 None] Lock "cinder-quobyte-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:40:01 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-fe1f6c24-a6aa-4a53-a493-8af1b912d3ad tempest-TestStampPattern-141219102 None] Acquiring lock "cinder-quobyte-4730852c-85d0-4a1c-9c53-fb9f37fcf6ec" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:40:01 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-fe1f6c24-a6aa-4a53-a493-8af1b912d3ad tempest-TestStampPattern-141219102 None] Lock "cinder-quobyte-4730852c-85d0-4a1c-9c53-fb9f37fcf6ec" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:40:01 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-fe1f6c24-a6aa-4a53-a493-8af1b912d3ad tempest-TestStampPattern-141219102 None] Deleting offline snapshot 4730852c-85d0-4a1c-9c53-fb9f37fcf6ec of volume b17e6e9c-10ab-4ba0-b20d-1224d031c3c8 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:40:01 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-fe1f6c24-a6aa-4a53-a493-8af1b912d3ad tempest-TestStampPattern-141219102 None] snapshot_file for this snap is: volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8.4730852c-85d0-4a1c-9c53-fb9f37fcf6ec {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:40:01 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0727005f-5b0e-4a72-9781-057e18fb2425]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:40:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-fe1f6c24-a6aa-4a53-a493-8af1b912d3ad tempest-TestStampPattern-141219102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8.4730852c-85d0-4a1c-9c53-fb9f37fcf6ec {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:01 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-cbbae840-48f0-4e42-9b7a-3914fb95148e tempest-GroupSnapshotsTest-2041888239 None] group_snapshot 0cff5bc6-56b6-4d87-ad4b-da2aad601091: created successfully Nov 02 15:40:01 devstack sudo[100403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8.4730852c-85d0-4a1c-9c53-fb9f37fcf6ec Nov 02 15:40:01 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:01 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-cd54f3aa-34e7-465e-9892-371b6293b737 1073741824" returned: 0 in 0.586s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:01 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-fe1f6c24-a6aa-4a53-a493-8af1b912d3ad tempest-TestStampPattern-141219102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8.4730852c-85d0-4a1c-9c53-fb9f37fcf6ec" returned: 0 in 0.489s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:01 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-fe1f6c24-a6aa-4a53-a493-8af1b912d3ad tempest-TestStampPattern-141219102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:40:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-cd54f3aa-34e7-465e-9892-371b6293b737 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:01 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed58634-888a-4cd6-8b15-0fb0162cc2cf]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:40:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-fe1f6c24-a6aa-4a53-a493-8af1b912d3ad tempest-TestStampPattern-141219102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:02 devstack sudo[100413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-cd54f3aa-34e7-465e-9892-371b6293b737 Nov 02 15:40:02 devstack sudo[100413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:02 devstack sudo[100414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8 Nov 02 15:40:02 devstack sudo[100414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:02 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-df443dc1-4a16-4e75-8418-ab313dd51f59 tempest-GroupSnapshotsTest-2041888239 None] group_snapshot 0cff5bc6-56b6-4d87-ad4b-da2aad601091: deleting Nov 02 15:40:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-df443dc1-4a16-4e75-8418-ab313dd51f59 tempest-GroupSnapshotsTest-2041888239 None] group_snapshot 0cff5bc6-56b6-4d87-ad4b-da2aad601091: deleting {{(pid=86703) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 02 15:40:02 devstack sudo[100413]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-cd54f3aa-34e7-465e-9892-371b6293b737" returned: 0 in 0.333s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:40:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:40:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (510750c7-1a47-40bd-aa94-fc6441789562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd54f3aa-34e7-465e-9892-371b6293b737', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff7c11fc-eeaf-4b59-a3cd-fcf9892536c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:02 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-df443dc1-4a16-4e75-8418-ab313dd51f59 tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "cinder-quobyte-d56ae6a2-3a1d-4471-8649-618073df5b09" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:40:02 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-df443dc1-4a16-4e75-8418-ab313dd51f59 tempest-GroupSnapshotsTest-2041888239 None] Lock "cinder-quobyte-d56ae6a2-3a1d-4471-8649-618073df5b09" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:40:02 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-df443dc1-4a16-4e75-8418-ab313dd51f59 tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "cinder-quobyte-406c3440-cef7-4373-ab06-79bfd9372fea" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:40:02 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] Volume volume-cd54f3aa-34e7-465e-9892-371b6293b737 (cd54f3aa-34e7-465e-9892-371b6293b737): created successfully Nov 02 15:40:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff7c11fc-eeaf-4b59-a3cd-fcf9892536c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] Flow 'volume_create_manager' (eaafae75-781e-4e25-9386-35b6f964b5a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:40:02 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-df443dc1-4a16-4e75-8418-ab313dd51f59 tempest-GroupSnapshotsTest-2041888239 None] Lock "cinder-quobyte-406c3440-cef7-4373-ab06-79bfd9372fea" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:40:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-df443dc1-4a16-4e75-8418-ab313dd51f59 tempest-GroupSnapshotsTest-2041888239 None] Deleting offline snapshot 406c3440-cef7-4373-ab06-79bfd9372fea of volume d56ae6a2-3a1d-4471-8649-618073df5b09 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:40:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-df443dc1-4a16-4e75-8418-ab313dd51f59 tempest-GroupSnapshotsTest-2041888239 None] snapshot_file for this snap is: volume-d56ae6a2-3a1d-4471-8649-618073df5b09.406c3440-cef7-4373-ab06-79bfd9372fea {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:40:02 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-5843c025-9243-4ccf-96b9-647522b45584 tempest-VolumesListTestJSON-660949084 None] Created volume successfully. Nov 02 15:40:02 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b3e8d1-ddb9-47f8-938f-2841aba5a5b9]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:40:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-df443dc1-4a16-4e75-8418-ab313dd51f59 tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09.406c3440-cef7-4373-ab06-79bfd9372fea {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:02 devstack sudo[100420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09.406c3440-cef7-4373-ab06-79bfd9372fea Nov 02 15:40:02 devstack sudo[100420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:02 devstack sudo[100414]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-fe1f6c24-a6aa-4a53-a493-8af1b912d3ad tempest-TestStampPattern-141219102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8" returned: 0 in 0.700s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-fe1f6c24-a6aa-4a53-a493-8af1b912d3ad tempest-TestStampPattern-141219102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8.4730852c-85d0-4a1c-9c53-fb9f37fcf6ec {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:02 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8.4730852c-85d0-4a1c-9c53-fb9f37fcf6ec Nov 02 15:40:02 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:02 devstack sudo[100420]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-df443dc1-4a16-4e75-8418-ab313dd51f59 tempest-GroupSnapshotsTest-2041888239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09.406c3440-cef7-4373-ab06-79bfd9372fea" returned: 0 in 0.417s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-df443dc1-4a16-4e75-8418-ab313dd51f59 tempest-GroupSnapshotsTest-2041888239 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d56ae6a2-3a1d-4471-8649-618073df5b09(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:40:02 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec29d54-1e3a-46a0-96a4-51c8ae2c1a7c]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:40:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-df443dc1-4a16-4e75-8418-ab313dd51f59 tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:03 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09 Nov 02 15:40:03 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:03 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-fe1f6c24-a6aa-4a53-a493-8af1b912d3ad tempest-TestStampPattern-141219102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8.4730852c-85d0-4a1c-9c53-fb9f37fcf6ec" returned: 0 in 0.448s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-fe1f6c24-a6aa-4a53-a493-8af1b912d3ad tempest-TestStampPattern-141219102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8.4730852c-85d0-4a1c-9c53-fb9f37fcf6ec {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:03 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8.4730852c-85d0-4a1c-9c53-fb9f37fcf6ec Nov 02 15:40:03 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:03 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-df443dc1-4a16-4e75-8418-ab313dd51f59 tempest-GroupSnapshotsTest-2041888239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09" returned: 0 in 0.484s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-df443dc1-4a16-4e75-8418-ab313dd51f59 tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09.406c3440-cef7-4373-ab06-79bfd9372fea {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:03 devstack sudo[100445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09.406c3440-cef7-4373-ab06-79bfd9372fea Nov 02 15:40:03 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:03 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-fe1f6c24-a6aa-4a53-a493-8af1b912d3ad tempest-TestStampPattern-141219102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8.4730852c-85d0-4a1c-9c53-fb9f37fcf6ec" returned: 0 in 0.354s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-fe1f6c24-a6aa-4a53-a493-8af1b912d3ad tempest-TestStampPattern-141219102 None] Lock "cinder-quobyte-4730852c-85d0-4a1c-9c53-fb9f37fcf6ec" released by "_delete_snapshot" :: held 2.205s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:40:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-fe1f6c24-a6aa-4a53-a493-8af1b912d3ad tempest-TestStampPattern-141219102 None] Lock "cinder-quobyte-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8" released by "delete_snapshot" :: held 2.249s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:40:03 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-fe1f6c24-a6aa-4a53-a493-8af1b912d3ad tempest-TestStampPattern-141219102 None] Created reservations ['5f098774-601d-4d67-9807-f9db8aca7c6a', '1e09daa3-8b06-4744-a0f2-a4b3ad458284', '070c202c-22da-4dcc-aa86-6c0b00304677', 'bb3668b0-bd16-4450-afc9-0cd3b70a893b'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:40:03 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-fe1f6c24-a6aa-4a53-a493-8af1b912d3ad tempest-TestStampPattern-141219102 None] Delete snapshot completed successfully. Nov 02 15:40:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-fe1f6c24-a6aa-4a53-a493-8af1b912d3ad tempest-TestStampPattern-141219102 None] Lock "cinder-4730852c-85d0-4a1c-9c53-fb9f37fcf6ec-delete_snapshot" released by "delete_snapshot" :: held 2.493s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:40:03 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:40:03 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] Flow 'volume_create_manager' (904e3dcb-b6ed-4474-9db2-1e350df2dcfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:40:03 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8c47e6b-285c-448d-8e38-f9e92315efd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:03 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8c47e6b-285c-448d-8e38-f9e92315efd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-848666222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bb9b5ff-6975-40ab-88e6-f9a95dbd8b4b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2adb4554439149c68a175b57ac2c4975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:40:04Z,use_quota=True,user_id='5564bfc2103649b385e14a1e5e7eac73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:03 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:03 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6738d26f-901f-41e3-b55c-e42b894860be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:03 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6738d26f-901f-41e3-b55c-e42b894860be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:03 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59c17cae-caa6-404c-a8fb-5cf0abe979b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:03 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59c17cae-caa6-404c-a8fb-5cf0abe979b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bb9b5ff-6975-40ab-88e6-f9a95dbd8b4b', 'volume_name': 'volume-5bb9b5ff-6975-40ab-88e6-f9a95dbd8b4b', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:03 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c75228-52ae-440b-9e3d-5736ee4d4f28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:03 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36c75228-52ae-440b-9e3d-5736ee4d4f28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:03 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (479d7171-5571-4b25-beb1-dd891a294c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:03 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] Volume 5bb9b5ff-6975-40ab-88e6-f9a95dbd8b4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bb9b5ff-6975-40ab-88e6-f9a95dbd8b4b', 'volume_size': 1} Nov 02 15:40:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:40:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:40:03 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-848666222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bb9b5ff-6975-40ab-88e6-f9a95dbd8b4b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2adb4554439149c68a175b57ac2c4975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:40:04Z,use_quota=True,user_id='5564bfc2103649b385e14a1e5e7eac73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:40:04 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] Creating volume 5bb9b5ff-6975-40ab-88e6-f9a95dbd8b4b {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:40:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:40:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:40:04 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:40:04 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:40:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:40:04 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:40:04 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:40:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5bb9b5ff-6975-40ab-88e6-f9a95dbd8b4b 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-df443dc1-4a16-4e75-8418-ab313dd51f59 tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09.406c3440-cef7-4373-ab06-79bfd9372fea" returned: 0 in 0.615s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-df443dc1-4a16-4e75-8418-ab313dd51f59 tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09.406c3440-cef7-4373-ab06-79bfd9372fea {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:04 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5bb9b5ff-6975-40ab-88e6-f9a95dbd8b4b 1073741824 Nov 02 15:40:04 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:04 devstack sudo[100452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09.406c3440-cef7-4373-ab06-79bfd9372fea Nov 02 15:40:04 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:04 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-df443dc1-4a16-4e75-8418-ab313dd51f59 tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09.406c3440-cef7-4373-ab06-79bfd9372fea" returned: 0 in 0.286s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:04 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-df443dc1-4a16-4e75-8418-ab313dd51f59 tempest-GroupSnapshotsTest-2041888239 None] Lock "cinder-quobyte-406c3440-cef7-4373-ab06-79bfd9372fea" released by "_delete_snapshot" :: held 1.949s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:40:04 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-df443dc1-4a16-4e75-8418-ab313dd51f59 tempest-GroupSnapshotsTest-2041888239 None] Lock "cinder-quobyte-d56ae6a2-3a1d-4471-8649-618073df5b09" released by "delete_snapshot" :: held 1.985s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:40:04 devstack cinder-volume[86703]: WARNING cinder.quota [None req-df443dc1-4a16-4e75-8418-ab313dd51f59 tempest-GroupSnapshotsTest-2041888239 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2123872316 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2123872316, it is now deprecated. Please use the default quota class for default quota. Nov 02 15:40:04 devstack cinder-volume[86703]: WARNING cinder.quota [None req-df443dc1-4a16-4e75-8418-ab313dd51f59 tempest-GroupSnapshotsTest-2041888239 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2123872316 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2123872316, it is now deprecated. Please use the default quota class for default quota. Nov 02 15:40:04 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-df443dc1-4a16-4e75-8418-ab313dd51f59 tempest-GroupSnapshotsTest-2041888239 None] Created reservations ['184e4735-40b1-4bd6-87c0-e15b3f149e98', '73ded288-1b3d-45c6-bf72-09109454f8be', 'a73fa794-2599-457d-96f6-4f679b2da0ed', 'ac7dcb27-cc78-49c5-8f67-264f85ad731e'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:40:04 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5bb9b5ff-6975-40ab-88e6-f9a95dbd8b4b 1073741824" returned: 0 in 0.549s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:04 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-df443dc1-4a16-4e75-8418-ab313dd51f59 tempest-GroupSnapshotsTest-2041888239 None] group_snapshot 0cff5bc6-56b6-4d87-ad4b-da2aad601091: deleted successfully Nov 02 15:40:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5bb9b5ff-6975-40ab-88e6-f9a95dbd8b4b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:04 devstack sudo[100460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5bb9b5ff-6975-40ab-88e6-f9a95dbd8b4b Nov 02 15:40:04 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:04 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5bb9b5ff-6975-40ab-88e6-f9a95dbd8b4b" returned: 0 in 0.354s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:04 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:40:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:40:05 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (479d7171-5571-4b25-beb1-dd891a294c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bb9b5ff-6975-40ab-88e6-f9a95dbd8b4b', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:05 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80b1230-15a9-404d-af7e-85f40209abed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:05 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] Volume volume-5bb9b5ff-6975-40ab-88e6-f9a95dbd8b4b (5bb9b5ff-6975-40ab-88e6-f9a95dbd8b4b): created successfully Nov 02 15:40:05 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80b1230-15a9-404d-af7e-85f40209abed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:05 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] Flow 'volume_create_manager' (904e3dcb-b6ed-4474-9db2-1e350df2dcfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:40:05 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-b84c6471-c646-471a-be64-f196b3fdb5d3 tempest-VolumesListTestJSON-660949084 None] Created volume successfully. Nov 02 15:40:05 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5185528c-b137-4d10-b585-fc985413ee1a tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "cinder-quobyte-d56ae6a2-3a1d-4471-8649-618073df5b09" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:40:05 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5185528c-b137-4d10-b585-fc985413ee1a tempest-GroupSnapshotsTest-2041888239 None] Lock "cinder-quobyte-d56ae6a2-3a1d-4471-8649-618073df5b09" acquired by "delete_volume" :: waited 0.024s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:40:05 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e994fef8-65d4-4f04-a517-e1d5d8ecbb83]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:40:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5185528c-b137-4d10-b585-fc985413ee1a tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:05 devstack sudo[100463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09 Nov 02 15:40:05 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:05 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5185528c-b137-4d10-b585-fc985413ee1a tempest-GroupSnapshotsTest-2041888239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09" returned: 0 in 0.486s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5185528c-b137-4d10-b585-fc985413ee1a tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:05 devstack sudo[100471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09 Nov 02 15:40:05 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:06 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5185528c-b137-4d10-b585-fc985413ee1a tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d56ae6a2-3a1d-4471-8649-618073df5b09" returned: 0 in 0.331s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5185528c-b137-4d10-b585-fc985413ee1a tempest-GroupSnapshotsTest-2041888239 None] Lock "cinder-quobyte-d56ae6a2-3a1d-4471-8649-618073df5b09" released by "delete_volume" :: held 0.920s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:40:06 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-5185528c-b137-4d10-b585-fc985413ee1a tempest-GroupSnapshotsTest-2041888239 None] Created reservations ['80103ab5-d76b-4445-9c31-44c5c1658e86'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:40:06 devstack cinder-volume[86703]: WARNING cinder.quota [None req-5185528c-b137-4d10-b585-fc985413ee1a tempest-GroupSnapshotsTest-2041888239 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2123872316 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2123872316, it is now deprecated. Please use the default quota class for default quota. Nov 02 15:40:06 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-5185528c-b137-4d10-b585-fc985413ee1a tempest-GroupSnapshotsTest-2041888239 None] Created reservations ['91eb4198-9415-48d8-bd0f-63f64f536b22', '57625e59-3176-4494-b5f2-309120f41d77', 'c4586d18-115a-422b-9e53-9be32b0cb83b', 'd16f2c5a-1acc-4a86-8be6-75cb3cb3f71f'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:40:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5185528c-b137-4d10-b585-fc985413ee1a tempest-GroupSnapshotsTest-2041888239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:40:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5185528c-b137-4d10-b585-fc985413ee1a tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:40:06 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-5185528c-b137-4d10-b585-fc985413ee1a tempest-GroupSnapshotsTest-2041888239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:40:06 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-5185528c-b137-4d10-b585-fc985413ee1a tempest-GroupSnapshotsTest-2041888239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:40:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5185528c-b137-4d10-b585-fc985413ee1a tempest-GroupSnapshotsTest-2041888239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:40:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5185528c-b137-4d10-b585-fc985413ee1a tempest-GroupSnapshotsTest-2041888239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:06 devstack sudo[100478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:40:06 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:07 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5185528c-b137-4d10-b585-fc985413ee1a tempest-GroupSnapshotsTest-2041888239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.442s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:07 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-5185528c-b137-4d10-b585-fc985413ee1a tempest-GroupSnapshotsTest-2041888239 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:40:07 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-5185528c-b137-4d10-b585-fc985413ee1a tempest-GroupSnapshotsTest-2041888239 None] Delete group completed successfully. Nov 02 15:40:10 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-417a2124-f73f-44f6-872d-606799cc4418 tempest-VolumesListTestJSON-660949084 None] Acquiring lock "cinder-5bb9b5ff-6975-40ab-88e6-f9a95dbd8b4b-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:40:10 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a1329f4c-f633-4f90-adfa-d7244cca4fa3 tempest-TestStampPattern-141219102 None] Acquiring lock "cinder-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:40:10 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-417a2124-f73f-44f6-872d-606799cc4418 tempest-VolumesListTestJSON-660949084 None] Lock "cinder-5bb9b5ff-6975-40ab-88e6-f9a95dbd8b4b-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:40:10 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a1329f4c-f633-4f90-adfa-d7244cca4fa3 tempest-TestStampPattern-141219102 None] Lock "cinder-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:40:10 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a1329f4c-f633-4f90-adfa-d7244cca4fa3 tempest-TestStampPattern-141219102 None] Acquiring lock "cinder-quobyte-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:40:10 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-417a2124-f73f-44f6-872d-606799cc4418 tempest-VolumesListTestJSON-660949084 None] Acquiring lock "cinder-quobyte-5bb9b5ff-6975-40ab-88e6-f9a95dbd8b4b" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:40:10 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a1329f4c-f633-4f90-adfa-d7244cca4fa3 tempest-TestStampPattern-141219102 None] Lock "cinder-quobyte-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8" acquired by "delete_volume" :: waited 0.027s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:40:10 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-417a2124-f73f-44f6-872d-606799cc4418 tempest-VolumesListTestJSON-660949084 None] Lock "cinder-quobyte-5bb9b5ff-6975-40ab-88e6-f9a95dbd8b4b" acquired by "delete_volume" :: waited 0.065s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:40:10 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ec6085-c1c3-4410-ad34-4e64e487ecf1]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:40:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a1329f4c-f633-4f90-adfa-d7244cca4fa3 tempest-TestStampPattern-141219102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:10 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78b7fda-667c-47c7-81fc-efbad28566ff]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:40:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-417a2124-f73f-44f6-872d-606799cc4418 tempest-VolumesListTestJSON-660949084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5bb9b5ff-6975-40ab-88e6-f9a95dbd8b4b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:10 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8 Nov 02 15:40:10 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:10 devstack sudo[100501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5bb9b5ff-6975-40ab-88e6-f9a95dbd8b4b Nov 02 15:40:10 devstack sudo[100501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:10 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a1329f4c-f633-4f90-adfa-d7244cca4fa3 tempest-TestStampPattern-141219102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8" returned: 0 in 0.474s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a1329f4c-f633-4f90-adfa-d7244cca4fa3 tempest-TestStampPattern-141219102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:10 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8 Nov 02 15:40:10 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:10 devstack sudo[100501]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-417a2124-f73f-44f6-872d-606799cc4418 tempest-VolumesListTestJSON-660949084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5bb9b5ff-6975-40ab-88e6-f9a95dbd8b4b" returned: 0 in 0.526s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-417a2124-f73f-44f6-872d-606799cc4418 tempest-VolumesListTestJSON-660949084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5bb9b5ff-6975-40ab-88e6-f9a95dbd8b4b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:10 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5bb9b5ff-6975-40ab-88e6-f9a95dbd8b4b Nov 02 15:40:10 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:11 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-417a2124-f73f-44f6-872d-606799cc4418 tempest-VolumesListTestJSON-660949084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5bb9b5ff-6975-40ab-88e6-f9a95dbd8b4b" returned: 0 in 0.346s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:11 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-417a2124-f73f-44f6-872d-606799cc4418 tempest-VolumesListTestJSON-660949084 None] Lock "cinder-quobyte-5bb9b5ff-6975-40ab-88e6-f9a95dbd8b4b" released by "delete_volume" :: held 0.939s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:40:11 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a1329f4c-f633-4f90-adfa-d7244cca4fa3 tempest-TestStampPattern-141219102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8" returned: 0 in 0.523s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:11 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a1329f4c-f633-4f90-adfa-d7244cca4fa3 tempest-TestStampPattern-141219102 None] Lock "cinder-quobyte-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8" released by "delete_volume" :: held 1.082s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:40:11 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-417a2124-f73f-44f6-872d-606799cc4418 tempest-VolumesListTestJSON-660949084 None] Created reservations ['f78be8de-3a44-4bc9-b73f-4ff600f7958c', 'e246edac-ef4a-481e-b24a-0354baa3398d', 'ea0e693f-85fa-4c01-aa8f-ae4f0347091b', '1ab422cd-4be1-441a-83a5-532800ced2d9'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:40:11 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-a1329f4c-f633-4f90-adfa-d7244cca4fa3 tempest-TestStampPattern-141219102 None] Created reservations ['0ad68c75-b4a9-422e-9898-d78e3845c14b', 'db067904-d679-43b5-bc18-cd25ef19a12e', '5c87a1e3-7d43-48a6-a770-f07a50f6e8c1', '946650de-61c8-4cfe-8739-d9aa59358e95'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:40:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-417a2124-f73f-44f6-872d-606799cc4418 tempest-VolumesListTestJSON-660949084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:40:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-417a2124-f73f-44f6-872d-606799cc4418 tempest-VolumesListTestJSON-660949084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:40:11 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-417a2124-f73f-44f6-872d-606799cc4418 tempest-VolumesListTestJSON-660949084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:40:11 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-417a2124-f73f-44f6-872d-606799cc4418 tempest-VolumesListTestJSON-660949084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:40:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-417a2124-f73f-44f6-872d-606799cc4418 tempest-VolumesListTestJSON-660949084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:40:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-417a2124-f73f-44f6-872d-606799cc4418 tempest-VolumesListTestJSON-660949084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:11 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:40:11 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a1329f4c-f633-4f90-adfa-d7244cca4fa3 tempest-TestStampPattern-141219102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:40:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a1329f4c-f633-4f90-adfa-d7244cca4fa3 tempest-TestStampPattern-141219102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:40:11 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-a1329f4c-f633-4f90-adfa-d7244cca4fa3 tempest-TestStampPattern-141219102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:40:11 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-a1329f4c-f633-4f90-adfa-d7244cca4fa3 tempest-TestStampPattern-141219102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:40:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a1329f4c-f633-4f90-adfa-d7244cca4fa3 tempest-TestStampPattern-141219102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:40:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a1329f4c-f633-4f90-adfa-d7244cca4fa3 tempest-TestStampPattern-141219102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:11 devstack sudo[100519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:40:11 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:11 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-417a2124-f73f-44f6-872d-606799cc4418 tempest-VolumesListTestJSON-660949084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.390s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:11 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-417a2124-f73f-44f6-872d-606799cc4418 tempest-VolumesListTestJSON-660949084 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:40:12 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-417a2124-f73f-44f6-872d-606799cc4418 tempest-VolumesListTestJSON-660949084 None] Deleted volume successfully. Nov 02 15:40:12 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-417a2124-f73f-44f6-872d-606799cc4418 tempest-VolumesListTestJSON-660949084 None] Lock "cinder-5bb9b5ff-6975-40ab-88e6-f9a95dbd8b4b-delete_volume" released by "delete_volume" :: held 1.948s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:40:12 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a1329f4c-f633-4f90-adfa-d7244cca4fa3 tempest-TestStampPattern-141219102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.412s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:12 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-a1329f4c-f633-4f90-adfa-d7244cca4fa3 tempest-TestStampPattern-141219102 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:40:12 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-a1329f4c-f633-4f90-adfa-d7244cca4fa3 tempest-TestStampPattern-141219102 None] Deleted volume successfully. Nov 02 15:40:12 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a1329f4c-f633-4f90-adfa-d7244cca4fa3 tempest-TestStampPattern-141219102 None] Lock "cinder-b17e6e9c-10ab-4ba0-b20d-1224d031c3c8-delete_volume" released by "delete_volume" :: held 2.002s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:40:12 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-06207c16-b4ba-4592-a731-c94c863ef6c1 tempest-VolumesListTestJSON-660949084 None] Acquiring lock "cinder-cd54f3aa-34e7-465e-9892-371b6293b737-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:40:12 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-06207c16-b4ba-4592-a731-c94c863ef6c1 tempest-VolumesListTestJSON-660949084 None] Lock "cinder-cd54f3aa-34e7-465e-9892-371b6293b737-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:40:12 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-06207c16-b4ba-4592-a731-c94c863ef6c1 tempest-VolumesListTestJSON-660949084 None] Acquiring lock "cinder-quobyte-cd54f3aa-34e7-465e-9892-371b6293b737" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:40:12 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-06207c16-b4ba-4592-a731-c94c863ef6c1 tempest-VolumesListTestJSON-660949084 None] Lock "cinder-quobyte-cd54f3aa-34e7-465e-9892-371b6293b737" acquired by "delete_volume" :: waited 0.034s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:40:12 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[039341b9-60d3-485c-9664-69116c9b2f66]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:40:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-06207c16-b4ba-4592-a731-c94c863ef6c1 tempest-VolumesListTestJSON-660949084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-cd54f3aa-34e7-465e-9892-371b6293b737 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:12 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-cd54f3aa-34e7-465e-9892-371b6293b737 Nov 02 15:40:12 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:13 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-06207c16-b4ba-4592-a731-c94c863ef6c1 tempest-VolumesListTestJSON-660949084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-cd54f3aa-34e7-465e-9892-371b6293b737" returned: 0 in 0.487s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-06207c16-b4ba-4592-a731-c94c863ef6c1 tempest-VolumesListTestJSON-660949084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-cd54f3aa-34e7-465e-9892-371b6293b737 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:13 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-cd54f3aa-34e7-465e-9892-371b6293b737 Nov 02 15:40:13 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:13 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-06207c16-b4ba-4592-a731-c94c863ef6c1 tempest-VolumesListTestJSON-660949084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-cd54f3aa-34e7-465e-9892-371b6293b737" returned: 0 in 0.374s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:13 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-06207c16-b4ba-4592-a731-c94c863ef6c1 tempest-VolumesListTestJSON-660949084 None] Lock "cinder-quobyte-cd54f3aa-34e7-465e-9892-371b6293b737" released by "delete_volume" :: held 0.942s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:40:13 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-06207c16-b4ba-4592-a731-c94c863ef6c1 tempest-VolumesListTestJSON-660949084 None] Created reservations ['4acf4855-281e-4f3a-829e-1a41ab3b5943', 'e6f79c9e-61ac-41f1-84be-edc695d31519', '0bb03b56-1cd3-408c-b9c9-95c5a9bfaafe', 'cd64d44a-b504-4ede-bec7-dbd3c7a8e9a5'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:40:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-06207c16-b4ba-4592-a731-c94c863ef6c1 tempest-VolumesListTestJSON-660949084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:40:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-06207c16-b4ba-4592-a731-c94c863ef6c1 tempest-VolumesListTestJSON-660949084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:40:13 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-06207c16-b4ba-4592-a731-c94c863ef6c1 tempest-VolumesListTestJSON-660949084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:40:13 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-06207c16-b4ba-4592-a731-c94c863ef6c1 tempest-VolumesListTestJSON-660949084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:40:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-06207c16-b4ba-4592-a731-c94c863ef6c1 tempest-VolumesListTestJSON-660949084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:40:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-06207c16-b4ba-4592-a731-c94c863ef6c1 tempest-VolumesListTestJSON-660949084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:13 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:40:13 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:14 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-06207c16-b4ba-4592-a731-c94c863ef6c1 tempest-VolumesListTestJSON-660949084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.386s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:14 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-06207c16-b4ba-4592-a731-c94c863ef6c1 tempest-VolumesListTestJSON-660949084 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:40:14 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-06207c16-b4ba-4592-a731-c94c863ef6c1 tempest-VolumesListTestJSON-660949084 None] Deleted volume successfully. Nov 02 15:40:14 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-06207c16-b4ba-4592-a731-c94c863ef6c1 tempest-VolumesListTestJSON-660949084 None] Lock "cinder-cd54f3aa-34e7-465e-9892-371b6293b737-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:40:14 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-aef22afc-f340-4714-8f0a-8678e23f7644 tempest-VolumesListTestJSON-660949084 None] Acquiring lock "cinder-eee44a41-6284-4e0c-a1b3-cfee63f7b1d4-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:40:14 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-aef22afc-f340-4714-8f0a-8678e23f7644 tempest-VolumesListTestJSON-660949084 None] Lock "cinder-eee44a41-6284-4e0c-a1b3-cfee63f7b1d4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:40:15 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-aef22afc-f340-4714-8f0a-8678e23f7644 tempest-VolumesListTestJSON-660949084 None] Acquiring lock "cinder-quobyte-eee44a41-6284-4e0c-a1b3-cfee63f7b1d4" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:40:15 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-aef22afc-f340-4714-8f0a-8678e23f7644 tempest-VolumesListTestJSON-660949084 None] Lock "cinder-quobyte-eee44a41-6284-4e0c-a1b3-cfee63f7b1d4" acquired by "delete_volume" :: waited 0.035s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:40:15 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec81c561-6370-4c30-ae51-d9bfa01bc327]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:40:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-aef22afc-f340-4714-8f0a-8678e23f7644 tempest-VolumesListTestJSON-660949084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-eee44a41-6284-4e0c-a1b3-cfee63f7b1d4 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:15 devstack sudo[100537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-eee44a41-6284-4e0c-a1b3-cfee63f7b1d4 Nov 02 15:40:15 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:15 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-aef22afc-f340-4714-8f0a-8678e23f7644 tempest-VolumesListTestJSON-660949084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-eee44a41-6284-4e0c-a1b3-cfee63f7b1d4" returned: 0 in 0.468s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-aef22afc-f340-4714-8f0a-8678e23f7644 tempest-VolumesListTestJSON-660949084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-eee44a41-6284-4e0c-a1b3-cfee63f7b1d4 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:15 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-eee44a41-6284-4e0c-a1b3-cfee63f7b1d4 Nov 02 15:40:15 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:15 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-aef22afc-f340-4714-8f0a-8678e23f7644 tempest-VolumesListTestJSON-660949084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-eee44a41-6284-4e0c-a1b3-cfee63f7b1d4" returned: 0 in 0.339s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:15 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-aef22afc-f340-4714-8f0a-8678e23f7644 tempest-VolumesListTestJSON-660949084 None] Lock "cinder-quobyte-eee44a41-6284-4e0c-a1b3-cfee63f7b1d4" released by "delete_volume" :: held 0.877s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:40:16 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-aef22afc-f340-4714-8f0a-8678e23f7644 tempest-VolumesListTestJSON-660949084 None] Created reservations ['ac4743ae-4671-4133-bb88-c04dffc07dd8', '3775130e-7ebb-423c-95f9-4ca268baedad', 'bccf38d9-44fd-4c3a-bdcb-c297d0ec1350', 'a8051e18-8abd-4bbb-aaee-9efbf4160bee'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:40:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-aef22afc-f340-4714-8f0a-8678e23f7644 tempest-VolumesListTestJSON-660949084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:40:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-aef22afc-f340-4714-8f0a-8678e23f7644 tempest-VolumesListTestJSON-660949084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:40:16 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-aef22afc-f340-4714-8f0a-8678e23f7644 tempest-VolumesListTestJSON-660949084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:40:16 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-aef22afc-f340-4714-8f0a-8678e23f7644 tempest-VolumesListTestJSON-660949084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:40:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-aef22afc-f340-4714-8f0a-8678e23f7644 tempest-VolumesListTestJSON-660949084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:40:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-aef22afc-f340-4714-8f0a-8678e23f7644 tempest-VolumesListTestJSON-660949084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:16 devstack sudo[100546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:40:16 devstack sudo[100546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:16 devstack sudo[100546]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-aef22afc-f340-4714-8f0a-8678e23f7644 tempest-VolumesListTestJSON-660949084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.367s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:16 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-aef22afc-f340-4714-8f0a-8678e23f7644 tempest-VolumesListTestJSON-660949084 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:40:16 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-aef22afc-f340-4714-8f0a-8678e23f7644 tempest-VolumesListTestJSON-660949084 None] Deleted volume successfully. Nov 02 15:40:16 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-aef22afc-f340-4714-8f0a-8678e23f7644 tempest-VolumesListTestJSON-660949084 None] Lock "cinder-eee44a41-6284-4e0c-a1b3-cfee63f7b1d4-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:40:20 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:40:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:40:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:40:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:40:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:40:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:40:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:20 devstack sudo[100550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:40:20 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:20 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.315s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:20 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:40:20 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager._thread_info {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:40:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread count: 29 {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 15:40:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread info: [<_MainThread(MainThread, started 125876361756800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 15:40:26 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=148,cinder:UPDATE=189,cinder:INSERT=49,cinder:DELETE=8 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:40:26 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=160,cinder:UPDATE=170,cinder:INSERT=38,cinder:DELETE=12 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:40:26 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:40:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Flow 'volume_create_manager' (f6100265-8084-407e-8f75-782b888972f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:40:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb71aa3-37e4-49dd-a702-a1b4a0ec5b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edb71aa3-37e4-49dd-a702-a1b4a0ec5b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1988390255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7132b43-8010-4bd9-a774-7deb1886d9dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4218747944e84e2492294b44014f31d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:40:27Z,use_quota=True,user_id='3c14ce9f9cc649918da2c5c582005b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca36d3ac-5351-4c23-a5ad-983947ff367d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca36d3ac-5351-4c23-a5ad-983947ff367d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81db7eb9-a934-4f5b-be08-343a2cf923a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81db7eb9-a934-4f5b-be08-343a2cf923a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7132b43-8010-4bd9-a774-7deb1886d9dc', 'volume_name': 'volume-a7132b43-8010-4bd9-a774-7deb1886d9dc', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d6c05e-9af2-476c-b10c-f87261e5371e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d6c05e-9af2-476c-b10c-f87261e5371e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f19b1f32-baca-4bfc-a691-c55f899cd990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:26 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Volume a7132b43-8010-4bd9-a774-7deb1886d9dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7132b43-8010-4bd9-a774-7deb1886d9dc', 'volume_size': 1} Nov 02 15:40:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:40:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:40:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1988390255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7132b43-8010-4bd9-a774-7deb1886d9dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4218747944e84e2492294b44014f31d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:40:27Z,use_quota=True,user_id='3c14ce9f9cc649918da2c5c582005b00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:40:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Creating volume a7132b43-8010-4bd9-a774-7deb1886d9dc {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:40:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:40:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:40:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:40:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:40:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:40:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:40:26 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:40:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a7132b43-8010-4bd9-a774-7deb1886d9dc 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:27 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a7132b43-8010-4bd9-a774-7deb1886d9dc 1073741824 Nov 02 15:40:27 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:27 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a7132b43-8010-4bd9-a774-7deb1886d9dc 1073741824" returned: 0 in 0.633s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a7132b43-8010-4bd9-a774-7deb1886d9dc {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:27 devstack sudo[100562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a7132b43-8010-4bd9-a774-7deb1886d9dc Nov 02 15:40:27 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:28 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a7132b43-8010-4bd9-a774-7deb1886d9dc" returned: 0 in 0.336s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:40:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:40:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f19b1f32-baca-4bfc-a691-c55f899cd990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7132b43-8010-4bd9-a774-7deb1886d9dc', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27c4c5a9-cf23-4a8f-9bd4-1133e7e1f456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:28 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Volume volume-a7132b43-8010-4bd9-a774-7deb1886d9dc (a7132b43-8010-4bd9-a774-7deb1886d9dc): created successfully Nov 02 15:40:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27c4c5a9-cf23-4a8f-9bd4-1133e7e1f456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Flow 'volume_create_manager' (f6100265-8084-407e-8f75-782b888972f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:40:28 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-8e1d953b-9224-4b2c-bffc-75949753b93e tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Created volume successfully. Nov 02 15:40:29 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:40:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] Flow 'volume_create_manager' (d14312f6-c46c-42d5-b03d-bcf32a1f8168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:40:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d46ad78b-33a2-48bd-b7d3-2bbed5393b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d46ad78b-33a2-48bd-b7d3-2bbed5393b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-860308429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d70dd375-0520-4fbc-8a75-289fd422efc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e418dc2db374ba8ab88080ebc3825ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:40:29Z,use_quota=True,user_id='35c85806badb4b21822e8df551381c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82a7013c-f8b2-4a42-92d3-9d4b89f2eb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82a7013c-f8b2-4a42-92d3-9d4b89f2eb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f48c248-c4a6-47d8-ad87-4c5dd0d05123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f48c248-c4a6-47d8-ad87-4c5dd0d05123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd70dd375-0520-4fbc-8a75-289fd422efc3', 'volume_name': 'volume-d70dd375-0520-4fbc-8a75-289fd422efc3', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8c09d5d-432d-402a-bce8-b7d04b81df11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8c09d5d-432d-402a-bce8-b7d04b81df11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (087e0575-885d-4193-98b4-ecea95acf9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:29 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] Volume d70dd375-0520-4fbc-8a75-289fd422efc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d70dd375-0520-4fbc-8a75-289fd422efc3', 'volume_size': 1} Nov 02 15:40:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:40:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:40:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:40:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-860308429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d70dd375-0520-4fbc-8a75-289fd422efc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e418dc2db374ba8ab88080ebc3825ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:40:29Z,use_quota=True,user_id='35c85806badb4b21822e8df551381c03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:40:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] Creating volume d70dd375-0520-4fbc-8a75-289fd422efc3 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:40:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:40:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:40:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:40:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:40:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:40:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:40:29 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:40:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:29 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3 1073741824 Nov 02 15:40:29 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:30 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3 1073741824" returned: 0 in 0.703s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:30 devstack sudo[100571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3 Nov 02 15:40:30 devstack sudo[100571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:30 devstack sudo[100571]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3" returned: 0 in 0.361s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:40:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:40:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (087e0575-885d-4193-98b4-ecea95acf9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d70dd375-0520-4fbc-8a75-289fd422efc3', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04fd92ba-05e7-48ea-8215-ca46e1e7a453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:30 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] Volume volume-d70dd375-0520-4fbc-8a75-289fd422efc3 (d70dd375-0520-4fbc-8a75-289fd422efc3): created successfully Nov 02 15:40:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04fd92ba-05e7-48ea-8215-ca46e1e7a453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] Flow 'volume_create_manager' (d14312f6-c46c-42d5-b03d-bcf32a1f8168) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:40:30 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-dbdd600b-b974-4855-b64a-a5f1b772e556 tempest-VolumesActionsTest-647963840 None] Created volume successfully. Nov 02 15:40:30 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-347a69a6-d13d-407b-b78a-7d5bc5e9fdb7 tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Acquiring lock "cinder-a7132b43-8010-4bd9-a774-7deb1886d9dc-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:40:30 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-347a69a6-d13d-407b-b78a-7d5bc5e9fdb7 tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Lock "cinder-a7132b43-8010-4bd9-a774-7deb1886d9dc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:40:30 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-347a69a6-d13d-407b-b78a-7d5bc5e9fdb7 tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Acquiring lock "cinder-quobyte-a7132b43-8010-4bd9-a774-7deb1886d9dc" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:40:30 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-347a69a6-d13d-407b-b78a-7d5bc5e9fdb7 tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Lock "cinder-quobyte-a7132b43-8010-4bd9-a774-7deb1886d9dc" acquired by "delete_volume" :: waited 0.019s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:40:30 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d616d4-588e-457f-b4f8-a349cfded0fc]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:40:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-347a69a6-d13d-407b-b78a-7d5bc5e9fdb7 tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a7132b43-8010-4bd9-a774-7deb1886d9dc {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:31 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a7132b43-8010-4bd9-a774-7deb1886d9dc Nov 02 15:40:31 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:31 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-347a69a6-d13d-407b-b78a-7d5bc5e9fdb7 tempest-VolumeQuotasNegativeTestJSON-1310875696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a7132b43-8010-4bd9-a774-7deb1886d9dc" returned: 0 in 0.514s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-347a69a6-d13d-407b-b78a-7d5bc5e9fdb7 tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a7132b43-8010-4bd9-a774-7deb1886d9dc {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:31 devstack sudo[100580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a7132b43-8010-4bd9-a774-7deb1886d9dc Nov 02 15:40:31 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:31 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-347a69a6-d13d-407b-b78a-7d5bc5e9fdb7 tempest-VolumeQuotasNegativeTestJSON-1310875696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a7132b43-8010-4bd9-a774-7deb1886d9dc" returned: 0 in 0.409s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:31 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-347a69a6-d13d-407b-b78a-7d5bc5e9fdb7 tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Lock "cinder-quobyte-a7132b43-8010-4bd9-a774-7deb1886d9dc" released by "delete_volume" :: held 0.983s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:40:31 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-347a69a6-d13d-407b-b78a-7d5bc5e9fdb7 tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Created reservations ['521d1277-ce67-4fe9-ad25-77e22bb0724b', '879d315f-0da8-4d88-964a-95556e2c9bd8', '528bfb48-d737-46ac-99d7-7e9b30e6db91', 'b2c87bb0-0e5f-43c7-be8a-76d25af06d78'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:40:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-347a69a6-d13d-407b-b78a-7d5bc5e9fdb7 tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:40:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-347a69a6-d13d-407b-b78a-7d5bc5e9fdb7 tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:40:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-347a69a6-d13d-407b-b78a-7d5bc5e9fdb7 tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:40:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-347a69a6-d13d-407b-b78a-7d5bc5e9fdb7 tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:40:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-347a69a6-d13d-407b-b78a-7d5bc5e9fdb7 tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:40:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-347a69a6-d13d-407b-b78a-7d5bc5e9fdb7 tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:32 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:40:32 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:32 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-347a69a6-d13d-407b-b78a-7d5bc5e9fdb7 tempest-VolumeQuotasNegativeTestJSON-1310875696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.329s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:32 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-347a69a6-d13d-407b-b78a-7d5bc5e9fdb7 tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:40:32 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-347a69a6-d13d-407b-b78a-7d5bc5e9fdb7 tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Deleted volume successfully. Nov 02 15:40:32 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-347a69a6-d13d-407b-b78a-7d5bc5e9fdb7 tempest-VolumeQuotasNegativeTestJSON-1310875696 None] Lock "cinder-a7132b43-8010-4bd9-a774-7deb1886d9dc-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:40:37 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:40:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] Flow 'volume_create_manager' (e32cde9a-e5b7-4cb4-90cc-d66df510c32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:40:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0fe85ae-7b02-4ab7-b9e4-56f77c4a1799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0fe85ae-7b02-4ab7-b9e4-56f77c4a1799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1064553225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13371452-1b7a-4a84-b4a2-4e8cfd5d2302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8099e14684ab40e49ad7c85d360b15b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:40:38Z,use_quota=True,user_id='eead0c3b4b5d4380875f44fe7cc8ba8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3153e1fd-e875-4dd6-8f20-6dffb5143aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3153e1fd-e875-4dd6-8f20-6dffb5143aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c977c07b-22b1-467d-8321-4c8e147fdacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c977c07b-22b1-467d-8321-4c8e147fdacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13371452-1b7a-4a84-b4a2-4e8cfd5d2302', 'volume_name': 'volume-13371452-1b7a-4a84-b4a2-4e8cfd5d2302', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41fdbe8e-4cfc-43af-bfad-97de44df750c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41fdbe8e-4cfc-43af-bfad-97de44df750c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f37d98b2-f199-40fa-976c-28c7f1910717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:38 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] Volume 13371452-1b7a-4a84-b4a2-4e8cfd5d2302: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13371452-1b7a-4a84-b4a2-4e8cfd5d2302', 'volume_size': 1} Nov 02 15:40:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:40:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:40:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1064553225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13371452-1b7a-4a84-b4a2-4e8cfd5d2302,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8099e14684ab40e49ad7c85d360b15b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:40:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:40:38Z,use_quota=True,user_id='eead0c3b4b5d4380875f44fe7cc8ba8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:40:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] Creating volume 13371452-1b7a-4a84-b4a2-4e8cfd5d2302 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:40:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:40:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:40:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:40:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:40:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:40:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:40:38 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:40:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-13371452-1b7a-4a84-b4a2-4e8cfd5d2302 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:38 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-13371452-1b7a-4a84-b4a2-4e8cfd5d2302 1073741824 Nov 02 15:40:38 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-13371452-1b7a-4a84-b4a2-4e8cfd5d2302 1073741824" returned: 0 in 0.693s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:38 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-13371452-1b7a-4a84-b4a2-4e8cfd5d2302 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:38 devstack sudo[100623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-13371452-1b7a-4a84-b4a2-4e8cfd5d2302 Nov 02 15:40:38 devstack sudo[100623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:39 devstack sudo[100623]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-13371452-1b7a-4a84-b4a2-4e8cfd5d2302" returned: 0 in 0.437s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:39 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:40:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:40:39 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f37d98b2-f199-40fa-976c-28c7f1910717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13371452-1b7a-4a84-b4a2-4e8cfd5d2302', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:39 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a183add3-3d68-47d5-8d5f-859fe7f16832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:39 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] Volume volume-13371452-1b7a-4a84-b4a2-4e8cfd5d2302 (13371452-1b7a-4a84-b4a2-4e8cfd5d2302): created successfully Nov 02 15:40:39 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a183add3-3d68-47d5-8d5f-859fe7f16832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:39 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] Flow 'volume_create_manager' (e32cde9a-e5b7-4cb4-90cc-d66df510c32a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:40:39 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-2a27f1a5-1902-44f8-a7bc-fdae3b64af72 tempest-ProjectReaderTests-767830875 None] Created volume successfully. Nov 02 15:40:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6dd8e92c-7d93-49ed-b287-00895660f694 tempest-ProjectReaderTests-767830875 None] Acquiring lock "cinder-13371452-1b7a-4a84-b4a2-4e8cfd5d2302-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:40:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6dd8e92c-7d93-49ed-b287-00895660f694 tempest-ProjectReaderTests-767830875 None] Lock "cinder-13371452-1b7a-4a84-b4a2-4e8cfd5d2302-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:40:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6dd8e92c-7d93-49ed-b287-00895660f694 tempest-ProjectReaderTests-767830875 None] Acquiring lock "cinder-quobyte-13371452-1b7a-4a84-b4a2-4e8cfd5d2302" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:40:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6dd8e92c-7d93-49ed-b287-00895660f694 tempest-ProjectReaderTests-767830875 None] Lock "cinder-quobyte-13371452-1b7a-4a84-b4a2-4e8cfd5d2302" acquired by "delete_volume" :: waited 0.025s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:40:40 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a532748e-d756-4f57-9bc8-1c5ed4c61967]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:40:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6dd8e92c-7d93-49ed-b287-00895660f694 tempest-ProjectReaderTests-767830875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-13371452-1b7a-4a84-b4a2-4e8cfd5d2302 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:41 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-13371452-1b7a-4a84-b4a2-4e8cfd5d2302 Nov 02 15:40:41 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:41 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6dd8e92c-7d93-49ed-b287-00895660f694 tempest-ProjectReaderTests-767830875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-13371452-1b7a-4a84-b4a2-4e8cfd5d2302" returned: 0 in 0.617s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6dd8e92c-7d93-49ed-b287-00895660f694 tempest-ProjectReaderTests-767830875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-13371452-1b7a-4a84-b4a2-4e8cfd5d2302 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:41 devstack sudo[100685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-13371452-1b7a-4a84-b4a2-4e8cfd5d2302 Nov 02 15:40:41 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:41 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6dd8e92c-7d93-49ed-b287-00895660f694 tempest-ProjectReaderTests-767830875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-13371452-1b7a-4a84-b4a2-4e8cfd5d2302" returned: 0 in 0.440s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:41 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6dd8e92c-7d93-49ed-b287-00895660f694 tempest-ProjectReaderTests-767830875 None] Lock "cinder-quobyte-13371452-1b7a-4a84-b4a2-4e8cfd5d2302" released by "delete_volume" :: held 1.171s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:40:42 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-6dd8e92c-7d93-49ed-b287-00895660f694 tempest-ProjectReaderTests-767830875 None] Created reservations ['a5177956-eae8-4a57-bc62-fd1f337d9c15', '20dc52f3-df95-44b3-bdfe-4cff21bd13ac', '62bff955-e457-4888-97a1-c0051ec2736a', 'c5ff3ee9-261f-4896-acfe-b9db346c130e'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:40:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-6dd8e92c-7d93-49ed-b287-00895660f694 tempest-ProjectReaderTests-767830875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:40:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-6dd8e92c-7d93-49ed-b287-00895660f694 tempest-ProjectReaderTests-767830875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:40:42 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-6dd8e92c-7d93-49ed-b287-00895660f694 tempest-ProjectReaderTests-767830875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:40:42 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-6dd8e92c-7d93-49ed-b287-00895660f694 tempest-ProjectReaderTests-767830875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:40:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-6dd8e92c-7d93-49ed-b287-00895660f694 tempest-ProjectReaderTests-767830875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:40:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6dd8e92c-7d93-49ed-b287-00895660f694 tempest-ProjectReaderTests-767830875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:42 devstack sudo[100689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:40:42 devstack sudo[100689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:42 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d2a17840-1628-4eac-807b-46af4dff921f tempest-VolumesActionsTest-647963840 None] Acquiring lock "cinder-d70dd375-0520-4fbc-8a75-289fd422efc3" by "attach_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:40:42 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d2a17840-1628-4eac-807b-46af4dff921f tempest-VolumesActionsTest-647963840 None] Lock "cinder-d70dd375-0520-4fbc-8a75-289fd422efc3" acquired by "attach_volume" :: waited 0.046s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:40:42 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-d2a17840-1628-4eac-807b-46af4dff921f tempest-VolumesActionsTest-647963840 None] Attaching volume d70dd375-0520-4fbc-8a75-289fd422efc3 to instance 98801928-743d-4c83-a890-0dad25b7447c at mountpoint /dev/vdb on host None. Nov 02 15:40:42 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-d2a17840-1628-4eac-807b-46af4dff921f tempest-VolumesActionsTest-647963840 None] Attach volume completed successfully. Nov 02 15:40:42 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d2a17840-1628-4eac-807b-46af4dff921f tempest-VolumesActionsTest-647963840 None] Lock "cinder-d70dd375-0520-4fbc-8a75-289fd422efc3" released by "attach_volume" :: held 0.217s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:40:42 devstack sudo[100689]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6dd8e92c-7d93-49ed-b287-00895660f694 tempest-ProjectReaderTests-767830875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.540s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:42 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-6dd8e92c-7d93-49ed-b287-00895660f694 tempest-ProjectReaderTests-767830875 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:40:42 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-6dd8e92c-7d93-49ed-b287-00895660f694 tempest-ProjectReaderTests-767830875 None] Deleted volume successfully. Nov 02 15:40:42 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6dd8e92c-7d93-49ed-b287-00895660f694 tempest-ProjectReaderTests-767830875 None] Lock "cinder-13371452-1b7a-4a84-b4a2-4e8cfd5d2302-delete_volume" released by "delete_volume" :: held 2.244s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:40:42 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-89b0e43d-f003-4b9a-84c9-a9c84713effc tempest-VolumesActionsTest-647963840 None] Acquiring lock "cinder-d70dd375-0520-4fbc-8a75-289fd422efc3-detach_volume" by "detach_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:40:42 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-89b0e43d-f003-4b9a-84c9-a9c84713effc tempest-VolumesActionsTest-647963840 None] Lock "cinder-d70dd375-0520-4fbc-8a75-289fd422efc3-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:40:42 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-89b0e43d-f003-4b9a-84c9-a9c84713effc tempest-VolumesActionsTest-647963840 None] Detaching volume d70dd375-0520-4fbc-8a75-289fd422efc3 from instance 98801928-743d-4c83-a890-0dad25b7447c. Nov 02 15:40:43 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-89b0e43d-f003-4b9a-84c9-a9c84713effc tempest-VolumesActionsTest-647963840 None] Detach volume completed successfully. Nov 02 15:40:43 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-89b0e43d-f003-4b9a-84c9-a9c84713effc tempest-VolumesActionsTest-647963840 None] Lock "cinder-d70dd375-0520-4fbc-8a75-289fd422efc3-detach_volume" released by "detach_volume" :: held 0.080s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:40:44 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:40:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] Flow 'volume_create_manager' (0c58a416-83c1-4cc9-a674-2e6209089ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:40:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be061d0-8ae6-4fde-a4bd-e3212e495081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be061d0-8ae6-4fde-a4bd-e3212e495081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1504103975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f4f387f-bf4a-4b1c-84b3-7b03e28d1d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8099e14684ab40e49ad7c85d360b15b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:40:44Z,use_quota=True,user_id='eead0c3b4b5d4380875f44fe7cc8ba8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515f87be-5838-4b74-b81d-a7b28a27a1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515f87be-5838-4b74-b81d-a7b28a27a1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50f37cda-b266-4acf-98ec-5363de21ab11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50f37cda-b266-4acf-98ec-5363de21ab11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f4f387f-bf4a-4b1c-84b3-7b03e28d1d30', 'volume_name': 'volume-3f4f387f-bf4a-4b1c-84b3-7b03e28d1d30', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (653be6f7-723d-4411-93ac-c998d96383cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (653be6f7-723d-4411-93ac-c998d96383cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3394bfb3-7d3d-4888-9b23-7d0b88984a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:44 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] Volume 3f4f387f-bf4a-4b1c-84b3-7b03e28d1d30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f4f387f-bf4a-4b1c-84b3-7b03e28d1d30', 'volume_size': 1} Nov 02 15:40:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:40:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:40:44 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1504103975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f4f387f-bf4a-4b1c-84b3-7b03e28d1d30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8099e14684ab40e49ad7c85d360b15b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:40:44Z,use_quota=True,user_id='eead0c3b4b5d4380875f44fe7cc8ba8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:40:44 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] Creating volume 3f4f387f-bf4a-4b1c-84b3-7b03e28d1d30 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:40:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:40:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:40:44 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:40:44 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:40:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:40:44 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:40:44 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:40:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3f4f387f-bf4a-4b1c-84b3-7b03e28d1d30 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:44 devstack sudo[100711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3f4f387f-bf4a-4b1c-84b3-7b03e28d1d30 1073741824 Nov 02 15:40:44 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:45 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3f4f387f-bf4a-4b1c-84b3-7b03e28d1d30 1073741824" returned: 0 in 0.741s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3f4f387f-bf4a-4b1c-84b3-7b03e28d1d30 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:45 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3f4f387f-bf4a-4b1c-84b3-7b03e28d1d30 Nov 02 15:40:45 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:45 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3f4f387f-bf4a-4b1c-84b3-7b03e28d1d30" returned: 0 in 0.321s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:45 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:40:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:40:45 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3394bfb3-7d3d-4888-9b23-7d0b88984a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f4f387f-bf4a-4b1c-84b3-7b03e28d1d30', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:45 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (431951f7-d530-4c5f-b9de-9ff4e7820be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:45 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] Volume volume-3f4f387f-bf4a-4b1c-84b3-7b03e28d1d30 (3f4f387f-bf4a-4b1c-84b3-7b03e28d1d30): created successfully Nov 02 15:40:45 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (431951f7-d530-4c5f-b9de-9ff4e7820be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:45 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] Flow 'volume_create_manager' (0c58a416-83c1-4cc9-a674-2e6209089ddb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:40:45 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-1cc813e5-674a-4fe9-9680-efe3fbf79e70 tempest-ProjectReaderTests-767830875 None] Created volume successfully. Nov 02 15:40:46 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-1aec58e1-a14f-4807-ae78-a2e967fb4b72 tempest-ProjectReaderTests-767830875 None] Acquiring lock "cinder-3f4f387f-bf4a-4b1c-84b3-7b03e28d1d30-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:40:46 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-1aec58e1-a14f-4807-ae78-a2e967fb4b72 tempest-ProjectReaderTests-767830875 None] Lock "cinder-3f4f387f-bf4a-4b1c-84b3-7b03e28d1d30-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:40:46 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-1aec58e1-a14f-4807-ae78-a2e967fb4b72 tempest-ProjectReaderTests-767830875 None] Acquiring lock "cinder-quobyte-3f4f387f-bf4a-4b1c-84b3-7b03e28d1d30" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:40:46 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-1aec58e1-a14f-4807-ae78-a2e967fb4b72 tempest-ProjectReaderTests-767830875 None] Lock "cinder-quobyte-3f4f387f-bf4a-4b1c-84b3-7b03e28d1d30" acquired by "delete_volume" :: waited 0.046s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:40:46 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0675cca-5de8-451d-a86e-600cf21b25f1]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:40:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1aec58e1-a14f-4807-ae78-a2e967fb4b72 tempest-ProjectReaderTests-767830875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3f4f387f-bf4a-4b1c-84b3-7b03e28d1d30 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:46 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:40:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] Flow 'volume_create_manager' (1a454b23-9994-40ed-9523-387cb530858d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:40:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94660edb-e97f-4c40-801b-7ddec3eeef9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94660edb-e97f-4c40-801b-7ddec3eeef9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1996977534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e5c679-b006-4bdc-87d1-8d51b145b656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90a536c5803949cfbd33f2eb3ca0bf31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:40:46Z,use_quota=True,user_id='a0e7eda50a4649f4b4b5b0a65a77bd27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5a7145e-3623-476b-8c26-d1026796ea5a),volume_type_id=e5a7145e-3623-476b-8c26-d1026796ea5a)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eeeb4c7-aa2a-499a-b46c-b9ada76f5b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eeeb4c7-aa2a-499a-b46c-b9ada76f5b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64434738-f5e8-4d23-9110-8d2a0e111398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64434738-f5e8-4d23-9110-8d2a0e111398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69e5c679-b006-4bdc-87d1-8d51b145b656', 'volume_name': 'volume-69e5c679-b006-4bdc-87d1-8d51b145b656', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff6df631-64b2-4b66-9f7f-d315afa95397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff6df631-64b2-4b66-9f7f-d315afa95397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3736f49-efe7-4f16-8be1-d09003ac536c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:46 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] Volume 69e5c679-b006-4bdc-87d1-8d51b145b656: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69e5c679-b006-4bdc-87d1-8d51b145b656', 'volume_size': 1} Nov 02 15:40:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:40:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:40:46 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1996977534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69e5c679-b006-4bdc-87d1-8d51b145b656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90a536c5803949cfbd33f2eb3ca0bf31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:40:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:40:46Z,use_quota=True,user_id='a0e7eda50a4649f4b4b5b0a65a77bd27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5a7145e-3623-476b-8c26-d1026796ea5a),volume_type_id=e5a7145e-3623-476b-8c26-d1026796ea5a)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:40:46 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] Creating volume 69e5c679-b006-4bdc-87d1-8d51b145b656 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:40:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:40:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:40:46 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:40:46 devstack sudo[100725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3f4f387f-bf4a-4b1c-84b3-7b03e28d1d30 Nov 02 15:40:46 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:46 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:40:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:40:46 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:40:46 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:40:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-69e5c679-b006-4bdc-87d1-8d51b145b656 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:46 devstack sudo[100727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-69e5c679-b006-4bdc-87d1-8d51b145b656 1073741824 Nov 02 15:40:46 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:47 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1aec58e1-a14f-4807-ae78-a2e967fb4b72 tempest-ProjectReaderTests-767830875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3f4f387f-bf4a-4b1c-84b3-7b03e28d1d30" returned: 0 in 0.556s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1aec58e1-a14f-4807-ae78-a2e967fb4b72 tempest-ProjectReaderTests-767830875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3f4f387f-bf4a-4b1c-84b3-7b03e28d1d30 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:47 devstack sudo[100736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3f4f387f-bf4a-4b1c-84b3-7b03e28d1d30 Nov 02 15:40:47 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:47 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-69e5c679-b006-4bdc-87d1-8d51b145b656 1073741824" returned: 0 in 0.710s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-69e5c679-b006-4bdc-87d1-8d51b145b656 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:47 devstack sudo[100740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-69e5c679-b006-4bdc-87d1-8d51b145b656 Nov 02 15:40:47 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:47 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1aec58e1-a14f-4807-ae78-a2e967fb4b72 tempest-ProjectReaderTests-767830875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3f4f387f-bf4a-4b1c-84b3-7b03e28d1d30" returned: 0 in 0.414s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:47 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-1aec58e1-a14f-4807-ae78-a2e967fb4b72 tempest-ProjectReaderTests-767830875 None] Lock "cinder-quobyte-3f4f387f-bf4a-4b1c-84b3-7b03e28d1d30" released by "delete_volume" :: held 1.070s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:40:47 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-1aec58e1-a14f-4807-ae78-a2e967fb4b72 tempest-ProjectReaderTests-767830875 None] Created reservations ['a0731b22-bee3-4d9c-962b-68ee208bdc3a', '3a3b9b41-54cb-4ea8-8659-f8c2682ec561', '568106df-0bae-4416-872c-f57a45a917ea', 'bbe1ead4-0636-450a-aabc-6a92823b15ea'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:40:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1aec58e1-a14f-4807-ae78-a2e967fb4b72 tempest-ProjectReaderTests-767830875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:40:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1aec58e1-a14f-4807-ae78-a2e967fb4b72 tempest-ProjectReaderTests-767830875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:40:47 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1aec58e1-a14f-4807-ae78-a2e967fb4b72 tempest-ProjectReaderTests-767830875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:40:47 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1aec58e1-a14f-4807-ae78-a2e967fb4b72 tempest-ProjectReaderTests-767830875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:40:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1aec58e1-a14f-4807-ae78-a2e967fb4b72 tempest-ProjectReaderTests-767830875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:40:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1aec58e1-a14f-4807-ae78-a2e967fb4b72 tempest-ProjectReaderTests-767830875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:47 devstack sudo[100742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:40:47 devstack sudo[100742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:47 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-69e5c679-b006-4bdc-87d1-8d51b145b656" returned: 0 in 0.360s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:47 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:40:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:40:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3736f49-efe7-4f16-8be1-d09003ac536c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69e5c679-b006-4bdc-87d1-8d51b145b656', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b490a4d7-dc97-449c-9f09-2b7187403fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:40:47 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] Volume volume-69e5c679-b006-4bdc-87d1-8d51b145b656 (69e5c679-b006-4bdc-87d1-8d51b145b656): created successfully Nov 02 15:40:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b490a4d7-dc97-449c-9f09-2b7187403fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:40:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] Flow 'volume_create_manager' (1a454b23-9994-40ed-9523-387cb530858d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:40:47 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-1e2eb57a-c8ed-42e3-bf0b-ae884c950d37 tempest-VolumeTypesAccessTest-93487963 None] Created volume successfully. Nov 02 15:40:48 devstack sudo[100742]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1aec58e1-a14f-4807-ae78-a2e967fb4b72 tempest-ProjectReaderTests-767830875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.316s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:48 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-1aec58e1-a14f-4807-ae78-a2e967fb4b72 tempest-ProjectReaderTests-767830875 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:40:48 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-1aec58e1-a14f-4807-ae78-a2e967fb4b72 tempest-ProjectReaderTests-767830875 None] Deleted volume successfully. Nov 02 15:40:48 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-1aec58e1-a14f-4807-ae78-a2e967fb4b72 tempest-ProjectReaderTests-767830875 None] Lock "cinder-3f4f387f-bf4a-4b1c-84b3-7b03e28d1d30-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:40:48 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d797bcbc-48bb-4de3-a840-b23961f8826d tempest-VolumeTypesAccessTest-93487963 None] Acquiring lock "cinder-69e5c679-b006-4bdc-87d1-8d51b145b656-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:40:48 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d797bcbc-48bb-4de3-a840-b23961f8826d tempest-VolumeTypesAccessTest-93487963 None] Lock "cinder-69e5c679-b006-4bdc-87d1-8d51b145b656-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:40:48 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d797bcbc-48bb-4de3-a840-b23961f8826d tempest-VolumeTypesAccessTest-93487963 None] Acquiring lock "cinder-quobyte-69e5c679-b006-4bdc-87d1-8d51b145b656" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:40:48 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d797bcbc-48bb-4de3-a840-b23961f8826d tempest-VolumeTypesAccessTest-93487963 None] Lock "cinder-quobyte-69e5c679-b006-4bdc-87d1-8d51b145b656" acquired by "delete_volume" :: waited 0.027s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:40:48 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0127e6ca-7dd0-4740-820a-3a6072f7dd2d]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:40:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d797bcbc-48bb-4de3-a840-b23961f8826d tempest-VolumeTypesAccessTest-93487963 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-69e5c679-b006-4bdc-87d1-8d51b145b656 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:48 devstack sudo[100746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-69e5c679-b006-4bdc-87d1-8d51b145b656 Nov 02 15:40:48 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:49 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d797bcbc-48bb-4de3-a840-b23961f8826d tempest-VolumeTypesAccessTest-93487963 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-69e5c679-b006-4bdc-87d1-8d51b145b656" returned: 0 in 0.509s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d797bcbc-48bb-4de3-a840-b23961f8826d tempest-VolumeTypesAccessTest-93487963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-69e5c679-b006-4bdc-87d1-8d51b145b656 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:49 devstack sudo[100751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-69e5c679-b006-4bdc-87d1-8d51b145b656 Nov 02 15:40:49 devstack sudo[100751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:49 devstack sudo[100751]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d797bcbc-48bb-4de3-a840-b23961f8826d tempest-VolumeTypesAccessTest-93487963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-69e5c679-b006-4bdc-87d1-8d51b145b656" returned: 0 in 0.380s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:49 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d797bcbc-48bb-4de3-a840-b23961f8826d tempest-VolumeTypesAccessTest-93487963 None] Lock "cinder-quobyte-69e5c679-b006-4bdc-87d1-8d51b145b656" released by "delete_volume" :: held 0.939s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:40:49 devstack cinder-volume[86703]: WARNING cinder.quota [None req-d797bcbc-48bb-4de3-a840-b23961f8826d tempest-VolumeTypesAccessTest-93487963 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1379533682 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1379533682, it is now deprecated. Please use the default quota class for default quota. Nov 02 15:40:49 devstack cinder-volume[86703]: WARNING cinder.quota [None req-d797bcbc-48bb-4de3-a840-b23961f8826d tempest-VolumeTypesAccessTest-93487963 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1379533682 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1379533682, it is now deprecated. Please use the default quota class for default quota. Nov 02 15:40:49 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-d797bcbc-48bb-4de3-a840-b23961f8826d tempest-VolumeTypesAccessTest-93487963 None] Created reservations ['73b24988-342d-4468-a2f7-3deb9589bfd4', 'e9a8a7eb-a644-48a7-adb2-cf61be447706', 'c2fb7bad-3c86-4555-bc04-a6aef7b39ec5', 'ad30af00-c33b-4e23-b2ff-78eec467c3fc'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:40:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d797bcbc-48bb-4de3-a840-b23961f8826d tempest-VolumeTypesAccessTest-93487963 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:40:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d797bcbc-48bb-4de3-a840-b23961f8826d tempest-VolumeTypesAccessTest-93487963 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:40:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d797bcbc-48bb-4de3-a840-b23961f8826d tempest-VolumeTypesAccessTest-93487963 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:40:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d797bcbc-48bb-4de3-a840-b23961f8826d tempest-VolumeTypesAccessTest-93487963 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:40:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d797bcbc-48bb-4de3-a840-b23961f8826d tempest-VolumeTypesAccessTest-93487963 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:40:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d797bcbc-48bb-4de3-a840-b23961f8826d tempest-VolumeTypesAccessTest-93487963 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:40:49 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:40:49 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:40:50 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Nov 02 15:40:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d797bcbc-48bb-4de3-a840-b23961f8826d tempest-VolumeTypesAccessTest-93487963 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.312s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:40:50 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-d797bcbc-48bb-4de3-a840-b23961f8826d tempest-VolumeTypesAccessTest-93487963 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:40:50 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-d797bcbc-48bb-4de3-a840-b23961f8826d tempest-VolumeTypesAccessTest-93487963 None] Deleted volume successfully. Nov 02 15:40:50 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d797bcbc-48bb-4de3-a840-b23961f8826d tempest-VolumeTypesAccessTest-93487963 None] Lock "cinder-69e5c679-b006-4bdc-87d1-8d51b145b656-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:40:59 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:UPDATE=48,cinder:SELECT=31,cinder:DELETE=4,cinder:INSERT=12 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:41:00 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=42,cinder:INSERT=11,cinder:UPDATE=52,cinder:DELETE=5 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:41:15 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-bd7d7471-0e61-4678-acd0-6622d8d3646b tempest-VolumesActionsTest-647963840 None] Acquiring lock "cinder-d70dd375-0520-4fbc-8a75-289fd422efc3" by "attach_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:41:15 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-bd7d7471-0e61-4678-acd0-6622d8d3646b tempest-VolumesActionsTest-647963840 None] Lock "cinder-d70dd375-0520-4fbc-8a75-289fd422efc3" acquired by "attach_volume" :: waited 0.056s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:41:15 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-bd7d7471-0e61-4678-acd0-6622d8d3646b tempest-VolumesActionsTest-647963840 None] Attaching volume d70dd375-0520-4fbc-8a75-289fd422efc3 to instance ff8419d2-6e7c-4010-b5bf-ff9cccaea890 at mountpoint /dev/vdb on host None. Nov 02 15:41:15 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-bd7d7471-0e61-4678-acd0-6622d8d3646b tempest-VolumesActionsTest-647963840 None] Attach volume completed successfully. Nov 02 15:41:15 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-bd7d7471-0e61-4678-acd0-6622d8d3646b tempest-VolumesActionsTest-647963840 None] Lock "cinder-d70dd375-0520-4fbc-8a75-289fd422efc3" released by "attach_volume" :: held 0.289s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:41:16 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-82ffc8d2-c356-4200-a679-d033c5a11e40 tempest-VolumesActionsTest-647963840 None] Acquiring lock "cinder-d70dd375-0520-4fbc-8a75-289fd422efc3-detach_volume" by "detach_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:41:16 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-82ffc8d2-c356-4200-a679-d033c5a11e40 tempest-VolumesActionsTest-647963840 None] Lock "cinder-d70dd375-0520-4fbc-8a75-289fd422efc3-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:41:16 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-82ffc8d2-c356-4200-a679-d033c5a11e40 tempest-VolumesActionsTest-647963840 None] Detaching volume d70dd375-0520-4fbc-8a75-289fd422efc3 from instance ff8419d2-6e7c-4010-b5bf-ff9cccaea890. Nov 02 15:41:16 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-82ffc8d2-c356-4200-a679-d033c5a11e40 tempest-VolumesActionsTest-647963840 None] Detach volume completed successfully. Nov 02 15:41:16 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-82ffc8d2-c356-4200-a679-d033c5a11e40 tempest-VolumesActionsTest-647963840 None] Lock "cinder-d70dd375-0520-4fbc-8a75-289fd422efc3-detach_volume" released by "detach_volume" :: held 0.098s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:41:20 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:41:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:41:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:41:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:41:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:41:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:41:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:41:20 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:41:20 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:41:21 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Nov 02 15:41:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.555s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:41:21 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:41:21 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager._thread_info {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:41:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread count: 29 {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 15:41:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread info: [<_MainThread(MainThread, started 125876361756800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 15:41:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-654a5f95-bf06-415a-9c98-b9d5abf325cd tempest-VolumesActionsTest-647963840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:41:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-654a5f95-bf06-415a-9c98-b9d5abf325cd tempest-VolumesActionsTest-647963840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.005s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:41:25 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3e302e-d077-4dc4-9d62-a70e30d88547]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:41:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-654a5f95-bf06-415a-9c98-b9d5abf325cd tempest-VolumesActionsTest-647963840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:41:25 devstack sudo[101013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3 Nov 02 15:41:25 devstack sudo[101013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:41:25 devstack sudo[101013]: pam_unix(sudo:session): session closed for user root Nov 02 15:41:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-654a5f95-bf06-415a-9c98-b9d5abf325cd tempest-VolumesActionsTest-647963840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3" returned: 0 in 0.705s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:41:25 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[94610747-66bf-4ee5-8cf9-91bfa9c05912]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:41:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-654a5f95-bf06-415a-9c98-b9d5abf325cd tempest-VolumesActionsTest-647963840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:41:25 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3 Nov 02 15:41:25 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:41:26 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:41:26 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Nov 02 15:41:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-654a5f95-bf06-415a-9c98-b9d5abf325cd tempest-VolumesActionsTest-647963840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3" returned: 0 in 0.637s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:41:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-654a5f95-bf06-415a-9c98-b9d5abf325cd tempest-VolumesActionsTest-647963840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3 /opt/stack/data/cinder/conversion/d70dd375-0520-4fbc-8a75-289fd422efc3.temp_image.c384ad0b-d455-485f-9331-278bceffa43c4ng13r8l.img {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:41:26 devstack sudo[101027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3 /opt/stack/data/cinder/conversion/d70dd375-0520-4fbc-8a75-289fd422efc3.temp_image.c384ad0b-d455-485f-9331-278bceffa43c4ng13r8l.img Nov 02 15:41:26 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:41:27 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:41:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] Flow 'volume_create_manager' (ff4d63dc-7316-4af5-a257-cf81040bd635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:41:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d1ef484-3899-4219-b062-d96ed01a4a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:41:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d1ef484-3899-4219-b062-d96ed01a4a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-146716317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=628ac9d9-d960-4f8b-8f9c-fa17303bf427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c502b240ce44a4a8c3287630e76227f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:41:27Z,use_quota=True,user_id='843ab47c94ac47b68c4bf8de40ebe1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:41:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82ad1c66-3c4c-4e87-9300-51e187610283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:41:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82ad1c66-3c4c-4e87-9300-51e187610283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:41:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acb1e214-22ec-49b2-bda5-4e1ec3861252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:41:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acb1e214-22ec-49b2-bda5-4e1ec3861252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '628ac9d9-d960-4f8b-8f9c-fa17303bf427', 'volume_name': 'volume-628ac9d9-d960-4f8b-8f9c-fa17303bf427', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:41:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c45b498-54d9-4545-b0a8-76b4f9a7d40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:41:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c45b498-54d9-4545-b0a8-76b4f9a7d40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:41:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060f2b5a-5541-416d-b3b2-f106a55963ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:41:27 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] Volume 628ac9d9-d960-4f8b-8f9c-fa17303bf427: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-628ac9d9-d960-4f8b-8f9c-fa17303bf427', 'volume_size': 1} Nov 02 15:41:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:41:35 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root Nov 02 15:41:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-654a5f95-bf06-415a-9c98-b9d5abf325cd tempest-VolumesActionsTest-647963840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3 /opt/stack/data/cinder/conversion/d70dd375-0520-4fbc-8a75-289fd422efc3.temp_image.c384ad0b-d455-485f-9331-278bceffa43c4ng13r8l.img" returned: 0 in 9.183s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:41:35 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7328f714-13ee-4303-b999-d042465c15ab]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:41:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-654a5f95-bf06-415a-9c98-b9d5abf325cd tempest-VolumesActionsTest-647963840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:41:35 devstack sudo[101060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3 Nov 02 15:41:35 devstack sudo[101060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:41:36 devstack sudo[101060]: pam_unix(sudo:session): session closed for user root Nov 02 15:41:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-654a5f95-bf06-415a-9c98-b9d5abf325cd tempest-VolumesActionsTest-647963840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3" returned: 0 in 0.555s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:41:36 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-654a5f95-bf06-415a-9c98-b9d5abf325cd tempest-VolumesActionsTest-647963840 None] Image conversion details: src /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3, size 1024.00 MB, duration 9.18 sec, destination /opt/stack/data/cinder/conversion/d70dd375-0520-4fbc-8a75-289fd422efc3.temp_image.c384ad0b-d455-485f-9331-278bceffa43c4ng13r8l.img {{(pid=86703) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 15:41:36 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-654a5f95-bf06-415a-9c98-b9d5abf325cd tempest-VolumesActionsTest-647963840 None] Converted 1024.00 MB image at 111.49 MB/s Nov 02 15:41:36 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-654a5f95-bf06-415a-9c98-b9d5abf325cd tempest-VolumesActionsTest-647963840 None] c384ad0b-d455-485f-9331-278bceffa43c was raw, no need to convert to raw {{(pid=86703) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 02 15:41:36 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:41:36 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] Flow 'volume_create_manager' (767bcb7f-4c0c-48c1-bf07-2b5c6b32a116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:41:36 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdde6b07-d07a-429a-9377-4b3cddf861f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:41:36 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdde6b07-d07a-429a-9377-4b3cddf861f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-954817035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e176a3f-349b-47f7-98e7-553910275252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2696f990f0a144eb970b5fec6bdfebb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:41:36Z,use_quota=True,user_id='5056b280b7ad4d21b99178231bc20917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:41:36 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee05dde-4ea4-4782-8be6-7024ce15b89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:41:36 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee05dde-4ea4-4782-8be6-7024ce15b89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:41:36 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c929a21f-6b1f-4ac9-a98f-cf766c5a79ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:41:36 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c929a21f-6b1f-4ac9-a98f-cf766c5a79ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e176a3f-349b-47f7-98e7-553910275252', 'volume_name': 'volume-2e176a3f-349b-47f7-98e7-553910275252', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:41:36 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7443b98-46b2-4cc8-89a5-24017fad0c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:41:36 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7443b98-46b2-4cc8-89a5-24017fad0c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:41:36 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd087eb-76a3-4a7a-a9b2-f8a45f2892fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:41:36 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] Volume 2e176a3f-349b-47f7-98e7-553910275252: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e176a3f-349b-47f7-98e7-553910275252', 'volume_size': 1} Nov 02 15:41:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:41:46 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=3 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:41:46 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:INSERT=1,cinder:SELECT=11,cinder:UPDATE=5 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:41:46 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:41:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Flow 'volume_create_manager' (af462061-d984-4d7f-b391-480f0f2009da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:41:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8249451f-2d42-4807-81dc-ccb48e3df810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:41:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8249451f-2d42-4807-81dc-ccb48e3df810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-154192095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c314237-4dc8-46d1-86ee-2349f60f959b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5906f72e4a88458f9a43be0dee084bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:41:46Z,use_quota=True,user_id='8ef81d106c2b4b10a508e27987d2a38b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:41:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1cacd83-9de4-4fe1-b1e9-38a49f554674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:41:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1cacd83-9de4-4fe1-b1e9-38a49f554674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:41:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (748fb4c4-0dae-42bf-989c-d0ed40caf794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:41:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (748fb4c4-0dae-42bf-989c-d0ed40caf794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c314237-4dc8-46d1-86ee-2349f60f959b', 'volume_name': 'volume-7c314237-4dc8-46d1-86ee-2349f60f959b', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:41:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97acb3f7-cad5-468b-9587-9122c8c6c57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:41:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97acb3f7-cad5-468b-9587-9122c8c6c57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:41:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6fc2e5e-7ebc-4762-86ef-9a5daa2be6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:41:46 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Volume 7c314237-4dc8-46d1-86ee-2349f60f959b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c314237-4dc8-46d1-86ee-2349f60f959b', 'volume_size': 1} Nov 02 15:41:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:41:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-654a5f95-bf06-415a-9c98-b9d5abf325cd tempest-VolumesActionsTest-647963840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.862s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:41:55 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-654a5f95-bf06-415a-9c98-b9d5abf325cd tempest-VolumesActionsTest-647963840 None] Uploaded volume to glance image-id: c384ad0b-d455-485f-9331-278bceffa43c. {{(pid=86703) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 15:41:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.083s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:41:55 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:41:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-146716317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=628ac9d9-d960-4f8b-8f9c-fa17303bf427,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c502b240ce44a4a8c3287630e76227f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:41:27Z,use_quota=True,user_id='843ab47c94ac47b68c4bf8de40ebe1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:41:55 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] Creating volume 628ac9d9-d960-4f8b-8f9c-fa17303bf427 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:41:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:41:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:41:55 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:41:55 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:41:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:41:55 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:41:55 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:41:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-628ac9d9-d960-4f8b-8f9c-fa17303bf427 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:41:55 devstack sudo[101109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-628ac9d9-d960-4f8b-8f9c-fa17303bf427 1073741824 Nov 02 15:41:55 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:41:55 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-654a5f95-bf06-415a-9c98-b9d5abf325cd tempest-VolumesActionsTest-647963840 None] Copy volume to image completed successfully. Nov 02 15:41:56 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root Nov 02 15:41:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-628ac9d9-d960-4f8b-8f9c-fa17303bf427 1073741824" returned: 0 in 0.471s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:41:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-628ac9d9-d960-4f8b-8f9c-fa17303bf427 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:41:56 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-628ac9d9-d960-4f8b-8f9c-fa17303bf427 Nov 02 15:41:56 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:41:56 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Nov 02 15:41:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-628ac9d9-d960-4f8b-8f9c-fa17303bf427" returned: 0 in 0.280s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:41:56 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:41:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:41:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.321s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:41:56 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-954817035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e176a3f-349b-47f7-98e7-553910275252,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2696f990f0a144eb970b5fec6bdfebb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:41:36Z,use_quota=True,user_id='5056b280b7ad4d21b99178231bc20917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:41:56 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] Creating volume 2e176a3f-349b-47f7-98e7-553910275252 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:41:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:41:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:41:56 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:41:56 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:41:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:41:56 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:41:56 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:41:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:41:56 devstack sudo[101117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252 1073741824 Nov 02 15:41:56 devstack sudo[101117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:41:56 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (060f2b5a-5541-416d-b3b2-f106a55963ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-628ac9d9-d960-4f8b-8f9c-fa17303bf427', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:41:56 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb9227d6-6fec-4fc3-90d4-8eb47ba12c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:41:56 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] Volume volume-628ac9d9-d960-4f8b-8f9c-fa17303bf427 (628ac9d9-d960-4f8b-8f9c-fa17303bf427): created successfully Nov 02 15:41:56 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb9227d6-6fec-4fc3-90d4-8eb47ba12c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:41:56 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] Flow 'volume_create_manager' (ff4d63dc-7316-4af5-a257-cf81040bd635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:41:56 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-9065035a-7709-439a-b148-44b1c2aa6014 tempest-VolumesTransfersV355Test-868307679 None] Created volume successfully. Nov 02 15:41:57 devstack sudo[101117]: pam_unix(sudo:session): session closed for user root Nov 02 15:41:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252 1073741824" returned: 0 in 0.486s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:41:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:41:57 devstack sudo[101123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252 Nov 02 15:41:57 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:41:57 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root Nov 02 15:41:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252" returned: 0 in 0.272s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:41:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:41:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:41:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.931s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:41:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-154192095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c314237-4dc8-46d1-86ee-2349f60f959b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5906f72e4a88458f9a43be0dee084bca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:41:46Z,use_quota=True,user_id='8ef81d106c2b4b10a508e27987d2a38b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:41:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Creating volume 7c314237-4dc8-46d1-86ee-2349f60f959b {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:41:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:41:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:41:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:41:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:41:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:41:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:41:57 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:41:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7c314237-4dc8-46d1-86ee-2349f60f959b 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:41:57 devstack sudo[101126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7c314237-4dc8-46d1-86ee-2349f60f959b 1073741824 Nov 02 15:41:57 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:41:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd087eb-76a3-4a7a-a9b2-f8a45f2892fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e176a3f-349b-47f7-98e7-553910275252', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:41:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaae4078-abf5-4f3c-bc39-74c42b4114e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:41:57 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] Volume volume-2e176a3f-349b-47f7-98e7-553910275252 (2e176a3f-349b-47f7-98e7-553910275252): created successfully Nov 02 15:41:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaae4078-abf5-4f3c-bc39-74c42b4114e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:41:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] Flow 'volume_create_manager' (767bcb7f-4c0c-48c1-bf07-2b5c6b32a116) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:41:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-bc32e0ec-5242-45b8-b796-ca7bc0c7f6d7 tempest-VolumesActionsTest-647963840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:41:57 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-787bca6c-31d4-45f6-bb00-577a3d7932af tempest-SnapshotDependencyTests-623161192 None] Created volume successfully. Nov 02 15:41:57 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root Nov 02 15:41:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7c314237-4dc8-46d1-86ee-2349f60f959b 1073741824" returned: 0 in 0.470s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:41:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7c314237-4dc8-46d1-86ee-2349f60f959b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:41:58 devstack sudo[101132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7c314237-4dc8-46d1-86ee-2349f60f959b Nov 02 15:41:58 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:41:58 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root Nov 02 15:41:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7c314237-4dc8-46d1-86ee-2349f60f959b" returned: 0 in 0.266s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:41:58 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:41:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:41:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-bc32e0ec-5242-45b8-b796-ca7bc0c7f6d7 tempest-VolumesActionsTest-647963840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.697s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:41:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6fc2e5e-7ebc-4762-86ef-9a5daa2be6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c314237-4dc8-46d1-86ee-2349f60f959b', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:41:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8ee5d0-9761-4b35-9ad1-6a38831c4629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:41:58 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[64af634d-d82c-45de-9bd3-918e88fc3d8a]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:41:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bc32e0ec-5242-45b8-b796-ca7bc0c7f6d7 tempest-VolumesActionsTest-647963840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:41:58 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Volume volume-7c314237-4dc8-46d1-86ee-2349f60f959b (7c314237-4dc8-46d1-86ee-2349f60f959b): created successfully Nov 02 15:41:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e8ee5d0-9761-4b35-9ad1-6a38831c4629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:41:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Flow 'volume_create_manager' (af462061-d984-4d7f-b391-480f0f2009da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:41:58 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-a7831a5e-ca24-40b8-895a-52b64442c715 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Created volume successfully. Nov 02 15:41:58 devstack sudo[101135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3 Nov 02 15:41:58 devstack sudo[101135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:41:58 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-0c8c79da-e794-41cb-8ec5-94937e0bd136 tempest-VolumesTransfersV355Test-579625240 None] Transfer volume completed successfully. Nov 02 15:41:58 devstack sudo[101135]: pam_unix(sudo:session): session closed for user root Nov 02 15:41:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bc32e0ec-5242-45b8-b796-ca7bc0c7f6d7 tempest-VolumesActionsTest-647963840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3" returned: 0 in 0.449s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:41:58 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74299e1-dbaf-4063-8ffb-b6179c028b97]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:41:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bc32e0ec-5242-45b8-b796-ca7bc0c7f6d7 tempest-VolumesActionsTest-647963840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:41:58 devstack sudo[101140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3 Nov 02 15:41:58 devstack sudo[101140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:41:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a1639b61-41b3-4028-aa19-669bfa1c0ae3 tempest-SnapshotDependencyTests-623161192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:41:59 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-34874c7d-96fe-41d4-b2fe-bc3fdfcbce37 tempest-VolumesTransfersV355Test-95385185 None] Acquiring lock "cinder-628ac9d9-d960-4f8b-8f9c-fa17303bf427-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:41:59 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-34874c7d-96fe-41d4-b2fe-bc3fdfcbce37 tempest-VolumesTransfersV355Test-95385185 None] Lock "cinder-628ac9d9-d960-4f8b-8f9c-fa17303bf427-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:41:59 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-34874c7d-96fe-41d4-b2fe-bc3fdfcbce37 tempest-VolumesTransfersV355Test-95385185 None] Acquiring lock "cinder-quobyte-628ac9d9-d960-4f8b-8f9c-fa17303bf427" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:41:59 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-34874c7d-96fe-41d4-b2fe-bc3fdfcbce37 tempest-VolumesTransfersV355Test-95385185 None] Lock "cinder-quobyte-628ac9d9-d960-4f8b-8f9c-fa17303bf427" acquired by "delete_volume" :: waited 0.018s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:41:59 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b8f016-ba43-4997-8bc3-b0e69ac970ef]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:41:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-34874c7d-96fe-41d4-b2fe-bc3fdfcbce37 tempest-VolumesTransfersV355Test-95385185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-628ac9d9-d960-4f8b-8f9c-fa17303bf427 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:41:59 devstack sudo[101140]: pam_unix(sudo:session): session closed for user root Nov 02 15:41:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bc32e0ec-5242-45b8-b796-ca7bc0c7f6d7 tempest-VolumesActionsTest-647963840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3" returned: 0 in 0.460s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:41:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bc32e0ec-5242-45b8-b796-ca7bc0c7f6d7 tempest-VolumesActionsTest-647963840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3 /opt/stack/data/cinder/conversion/d70dd375-0520-4fbc-8a75-289fd422efc3.temp_image.911d87b8-3c8f-4375-8a4e-4815b80eb864n066dw48.img {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:41:59 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3 /opt/stack/data/cinder/conversion/d70dd375-0520-4fbc-8a75-289fd422efc3.temp_image.911d87b8-3c8f-4375-8a4e-4815b80eb864n066dw48.img Nov 02 15:41:59 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:41:59 devstack sudo[101145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-628ac9d9-d960-4f8b-8f9c-fa17303bf427 Nov 02 15:41:59 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:41:59 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root Nov 02 15:41:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-34874c7d-96fe-41d4-b2fe-bc3fdfcbce37 tempest-VolumesTransfersV355Test-95385185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-628ac9d9-d960-4f8b-8f9c-fa17303bf427" returned: 0 in 0.588s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:41:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-34874c7d-96fe-41d4-b2fe-bc3fdfcbce37 tempest-VolumesTransfersV355Test-95385185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-628ac9d9-d960-4f8b-8f9c-fa17303bf427 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:41:59 devstack sudo[101162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-628ac9d9-d960-4f8b-8f9c-fa17303bf427 Nov 02 15:41:59 devstack sudo[101162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:00 devstack sudo[101162]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-34874c7d-96fe-41d4-b2fe-bc3fdfcbce37 tempest-VolumesTransfersV355Test-95385185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-628ac9d9-d960-4f8b-8f9c-fa17303bf427" returned: 0 in 0.463s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:00 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-34874c7d-96fe-41d4-b2fe-bc3fdfcbce37 tempest-VolumesTransfersV355Test-95385185 None] Lock "cinder-quobyte-628ac9d9-d960-4f8b-8f9c-fa17303bf427" released by "delete_volume" :: held 1.116s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:42:00 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-34874c7d-96fe-41d4-b2fe-bc3fdfcbce37 tempest-VolumesTransfersV355Test-95385185 None] Created reservations ['1465d86a-f084-48a0-ac1f-c4dee005d9d4', '30c69bce-bc28-453c-b85e-4046a2fb3a2a', 'cc2602dd-6749-4ef0-b2cc-82b7ac3405d6', 'faa887c8-2d31-4672-9b09-87cc1ab7659b'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:42:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-c6e29faa-ec09-45e4-859b-f879146a61d5 req-aaad6f76-8180-40bb-9fe4-be791f7d3075 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:42:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-34874c7d-96fe-41d4-b2fe-bc3fdfcbce37 tempest-VolumesTransfersV355Test-95385185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:42:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-34874c7d-96fe-41d4-b2fe-bc3fdfcbce37 tempest-VolumesTransfersV355Test-95385185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:00 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-34874c7d-96fe-41d4-b2fe-bc3fdfcbce37 tempest-VolumesTransfersV355Test-95385185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:42:00 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-34874c7d-96fe-41d4-b2fe-bc3fdfcbce37 tempest-VolumesTransfersV355Test-95385185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:42:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-34874c7d-96fe-41d4-b2fe-bc3fdfcbce37 tempest-VolumesTransfersV355Test-95385185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-34874c7d-96fe-41d4-b2fe-bc3fdfcbce37 tempest-VolumesTransfersV355Test-95385185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:00 devstack sudo[101173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:42:00 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:00 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-34874c7d-96fe-41d4-b2fe-bc3fdfcbce37 tempest-VolumesTransfersV355Test-95385185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.339s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:00 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-34874c7d-96fe-41d4-b2fe-bc3fdfcbce37 tempest-VolumesTransfersV355Test-95385185 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:42:00 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-34874c7d-96fe-41d4-b2fe-bc3fdfcbce37 tempest-VolumesTransfersV355Test-95385185 None] Deleted volume successfully. Nov 02 15:42:00 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-34874c7d-96fe-41d4-b2fe-bc3fdfcbce37 tempest-VolumesTransfersV355Test-95385185 None] Lock "cinder-628ac9d9-d960-4f8b-8f9c-fa17303bf427-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:42:02 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:42:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] Flow 'volume_create_manager' (4625423b-cf9d-4d34-ac60-7c4435108ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:42:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062d1669-a67b-4322-a0fa-95175d029824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062d1669-a67b-4322-a0fa-95175d029824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-296083826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=396b1f2b-7af7-4af5-a7c4-c0f5021dd0d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c502b240ce44a4a8c3287630e76227f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:42:02Z,use_quota=True,user_id='843ab47c94ac47b68c4bf8de40ebe1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3b1077-a820-478c-98d4-f470a0a9345f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3b1077-a820-478c-98d4-f470a0a9345f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0163d120-2980-4e2e-af37-43c44a543b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0163d120-2980-4e2e-af37-43c44a543b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '396b1f2b-7af7-4af5-a7c4-c0f5021dd0d3', 'volume_name': 'volume-396b1f2b-7af7-4af5-a7c4-c0f5021dd0d3', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15997cc5-bc73-47a1-a8c4-7cd7cd66a72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15997cc5-bc73-47a1-a8c4-7cd7cd66a72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a57c7978-74fc-49a9-8255-57ac794a03de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:02 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] Volume 396b1f2b-7af7-4af5-a7c4-c0f5021dd0d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-396b1f2b-7af7-4af5-a7c4-c0f5021dd0d3', 'volume_size': 1} Nov 02 15:42:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:42:05 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bc32e0ec-5242-45b8-b796-ca7bc0c7f6d7 tempest-VolumesActionsTest-647963840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3 /opt/stack/data/cinder/conversion/d70dd375-0520-4fbc-8a75-289fd422efc3.temp_image.911d87b8-3c8f-4375-8a4e-4815b80eb864n066dw48.img" returned: 0 in 6.449s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:05 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c26e674-bcce-4600-a3d8-17f2575b8320]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:42:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bc32e0ec-5242-45b8-b796-ca7bc0c7f6d7 tempest-VolumesActionsTest-647963840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:05 devstack sudo[101183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3 Nov 02 15:42:05 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:06 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bc32e0ec-5242-45b8-b796-ca7bc0c7f6d7 tempest-VolumesActionsTest-647963840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3" returned: 0 in 0.513s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:06 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-bc32e0ec-5242-45b8-b796-ca7bc0c7f6d7 tempest-VolumesActionsTest-647963840 None] Image conversion details: src /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3, size 1024.00 MB, duration 6.45 sec, destination /opt/stack/data/cinder/conversion/d70dd375-0520-4fbc-8a75-289fd422efc3.temp_image.911d87b8-3c8f-4375-8a4e-4815b80eb864n066dw48.img {{(pid=86703) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 15:42:06 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-bc32e0ec-5242-45b8-b796-ca7bc0c7f6d7 tempest-VolumesActionsTest-647963840 None] Converted 1024.00 MB image at 158.75 MB/s Nov 02 15:42:06 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-bc32e0ec-5242-45b8-b796-ca7bc0c7f6d7 tempest-VolumesActionsTest-647963840 None] 911d87b8-3c8f-4375-8a4e-4815b80eb864 was raw, converting to qcow2 {{(pid=86703) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 02 15:42:06 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4a54bf-3fef-49de-a7a4-022d9b6c05a3]: (4, 'raw') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:42:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bc32e0ec-5242-45b8-b796-ca7bc0c7f6d7 tempest-VolumesActionsTest-647963840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d70dd375-0520-4fbc-8a75-289fd422efc3.temp_image.911d87b8-3c8f-4375-8a4e-4815b80eb864n066dw48.img {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:06 devstack sudo[101189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d70dd375-0520-4fbc-8a75-289fd422efc3.temp_image.911d87b8-3c8f-4375-8a4e-4815b80eb864n066dw48.img Nov 02 15:42:06 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:06 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bc32e0ec-5242-45b8-b796-ca7bc0c7f6d7 tempest-VolumesActionsTest-647963840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/d70dd375-0520-4fbc-8a75-289fd422efc3.temp_image.911d87b8-3c8f-4375-8a4e-4815b80eb864n066dw48.img" returned: 0 in 0.342s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bc32e0ec-5242-45b8-b796-ca7bc0c7f6d7 tempest-VolumesActionsTest-647963840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d70dd375-0520-4fbc-8a75-289fd422efc3.temp_image.911d87b8-3c8f-4375-8a4e-4815b80eb864n066dw48.img {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:06 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d70dd375-0520-4fbc-8a75-289fd422efc3.temp_image.911d87b8-3c8f-4375-8a4e-4815b80eb864n066dw48.img Nov 02 15:42:06 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:06 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bc32e0ec-5242-45b8-b796-ca7bc0c7f6d7 tempest-VolumesActionsTest-647963840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d70dd375-0520-4fbc-8a75-289fd422efc3.temp_image.911d87b8-3c8f-4375-8a4e-4815b80eb864n066dw48.img" returned: 1 in 0.326s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bc32e0ec-5242-45b8-b796-ca7bc0c7f6d7 tempest-VolumesActionsTest-647963840 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/d70dd375-0520-4fbc-8a75-289fd422efc3.temp_image.911d87b8-3c8f-4375-8a4e-4815b80eb864n066dw48.img' failed. Not Retrying. {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 15:42:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bc32e0ec-5242-45b8-b796-ca7bc0c7f6d7 tempest-VolumesActionsTest-647963840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d70dd375-0520-4fbc-8a75-289fd422efc3.temp_image.911d87b8-3c8f-4375-8a4e-4815b80eb864n066dw48.img /opt/stack/data/cinder/conversion/vol_upload_ttkyy3zd {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:06 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d70dd375-0520-4fbc-8a75-289fd422efc3.temp_image.911d87b8-3c8f-4375-8a4e-4815b80eb864n066dw48.img /opt/stack/data/cinder/conversion/vol_upload_ttkyy3zd Nov 02 15:42:06 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:07 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bc32e0ec-5242-45b8-b796-ca7bc0c7f6d7 tempest-VolumesActionsTest-647963840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/d70dd375-0520-4fbc-8a75-289fd422efc3.temp_image.911d87b8-3c8f-4375-8a4e-4815b80eb864n066dw48.img /opt/stack/data/cinder/conversion/vol_upload_ttkyy3zd" returned: 0 in 0.247s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:07 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-bc32e0ec-5242-45b8-b796-ca7bc0c7f6d7 tempest-VolumesActionsTest-647963840 None] Image conversion details: src /opt/stack/data/cinder/conversion/d70dd375-0520-4fbc-8a75-289fd422efc3.temp_image.911d87b8-3c8f-4375-8a4e-4815b80eb864n066dw48.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ttkyy3zd {{(pid=86703) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 15:42:07 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-bc32e0ec-5242-45b8-b796-ca7bc0c7f6d7 tempest-VolumesActionsTest-647963840 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 02 15:42:07 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[55863867-d321-4eab-b430-2d218abc8772]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:42:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bc32e0ec-5242-45b8-b796-ca7bc0c7f6d7 tempest-VolumesActionsTest-647963840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ttkyy3zd {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:07 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ttkyy3zd Nov 02 15:42:07 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:07 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bc32e0ec-5242-45b8-b796-ca7bc0c7f6d7 tempest-VolumesActionsTest-647963840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ttkyy3zd" returned: 0 in 0.350s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-bc32e0ec-5242-45b8-b796-ca7bc0c7f6d7 tempest-VolumesActionsTest-647963840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.523s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:08 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-bc32e0ec-5242-45b8-b796-ca7bc0c7f6d7 tempest-VolumesActionsTest-647963840 None] Uploaded volume to glance image-id: 911d87b8-3c8f-4375-8a4e-4815b80eb864. {{(pid=86703) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 15:42:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a1639b61-41b3-4028-aa19-669bfa1c0ae3 tempest-SnapshotDependencyTests-623161192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.846s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:08 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-a1639b61-41b3-4028-aa19-669bfa1c0ae3 tempest-SnapshotDependencyTests-623161192 None] Creating offline snapshot 644729f2-22ba-4488-8120-49c6a345a0df of volume 2e176a3f-349b-47f7-98e7-553910275252 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:42:08 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-bc32e0ec-5242-45b8-b796-ca7bc0c7f6d7 tempest-VolumesActionsTest-647963840 None] Copy volume to image completed successfully. Nov 02 15:42:08 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b74073-5121-4a9d-b6e5-abe5aa135031]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:42:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a1639b61-41b3-4028-aa19-669bfa1c0ae3 tempest-SnapshotDependencyTests-623161192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:08 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252 Nov 02 15:42:08 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:09 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a1639b61-41b3-4028-aa19-669bfa1c0ae3 tempest-SnapshotDependencyTests-623161192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252" returned: 0 in 0.382s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a1639b61-41b3-4028-aa19-669bfa1c0ae3 tempest-SnapshotDependencyTests-623161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252.644729f2-22ba-4488-8120-49c6a345a0df 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:09 devstack sudo[101214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252.644729f2-22ba-4488-8120-49c6a345a0df 1G Nov 02 15:42:09 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:09 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a1639b61-41b3-4028-aa19-669bfa1c0ae3 tempest-SnapshotDependencyTests-623161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252.644729f2-22ba-4488-8120-49c6a345a0df 1G" returned: 0 in 0.416s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a1639b61-41b3-4028-aa19-669bfa1c0ae3 tempest-SnapshotDependencyTests-623161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e176a3f-349b-47f7-98e7-553910275252 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252.644729f2-22ba-4488-8120-49c6a345a0df {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:09 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e176a3f-349b-47f7-98e7-553910275252 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252.644729f2-22ba-4488-8120-49c6a345a0df Nov 02 15:42:09 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:09 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5b55f64c-b234-4657-9bad-4601374d47ff tempest-VolumesActionsTest-647963840 None] Acquiring lock "cinder-d70dd375-0520-4fbc-8a75-289fd422efc3-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:42:09 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5b55f64c-b234-4657-9bad-4601374d47ff tempest-VolumesActionsTest-647963840 None] Lock "cinder-d70dd375-0520-4fbc-8a75-289fd422efc3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:42:09 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5b55f64c-b234-4657-9bad-4601374d47ff tempest-VolumesActionsTest-647963840 None] Acquiring lock "cinder-quobyte-d70dd375-0520-4fbc-8a75-289fd422efc3" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:42:09 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5b55f64c-b234-4657-9bad-4601374d47ff tempest-VolumesActionsTest-647963840 None] Lock "cinder-quobyte-d70dd375-0520-4fbc-8a75-289fd422efc3" acquired by "delete_volume" :: waited 0.023s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:42:09 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[41915694-385f-4235-9ec9-fb7679bab2e8]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:42:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5b55f64c-b234-4657-9bad-4601374d47ff tempest-VolumesActionsTest-647963840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:09 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3 Nov 02 15:42:09 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:10 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a1639b61-41b3-4028-aa19-669bfa1c0ae3 tempest-SnapshotDependencyTests-623161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e176a3f-349b-47f7-98e7-553910275252 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252.644729f2-22ba-4488-8120-49c6a345a0df" returned: 0 in 0.335s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:10 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-a1639b61-41b3-4028-aa19-669bfa1c0ae3 tempest-SnapshotDependencyTests-623161192 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252.644729f2-22ba-4488-8120-49c6a345a0df is being set with open permissions: ugo+rw Nov 02 15:42:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a1639b61-41b3-4028-aa19-669bfa1c0ae3 tempest-SnapshotDependencyTests-623161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252.644729f2-22ba-4488-8120-49c6a345a0df {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:10 devstack sudo[101227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252.644729f2-22ba-4488-8120-49c6a345a0df Nov 02 15:42:10 devstack sudo[101227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:10 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5b55f64c-b234-4657-9bad-4601374d47ff tempest-VolumesActionsTest-647963840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3" returned: 0 in 0.373s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5b55f64c-b234-4657-9bad-4601374d47ff tempest-VolumesActionsTest-647963840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:10 devstack sudo[101227]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a1639b61-41b3-4028-aa19-669bfa1c0ae3 tempest-SnapshotDependencyTests-623161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252.644729f2-22ba-4488-8120-49c6a345a0df" returned: 0 in 0.263s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:10 devstack sudo[101233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3 Nov 02 15:42:10 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a1639b61-41b3-4028-aa19-669bfa1c0ae3 tempest-SnapshotDependencyTests-623161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:10 devstack sudo[101235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252.info Nov 02 15:42:10 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:10 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5b55f64c-b234-4657-9bad-4601374d47ff tempest-VolumesActionsTest-647963840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d70dd375-0520-4fbc-8a75-289fd422efc3" returned: 0 in 0.268s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:10 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5b55f64c-b234-4657-9bad-4601374d47ff tempest-VolumesActionsTest-647963840 None] Lock "cinder-quobyte-d70dd375-0520-4fbc-8a75-289fd422efc3" released by "delete_volume" :: held 0.693s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:42:10 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a1639b61-41b3-4028-aa19-669bfa1c0ae3 tempest-SnapshotDependencyTests-623161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252.info" returned: 0 in 0.265s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:10 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-a1639b61-41b3-4028-aa19-669bfa1c0ae3 tempest-SnapshotDependencyTests-623161192 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252.info is being set with open permissions: ugo+rw Nov 02 15:42:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a1639b61-41b3-4028-aa19-669bfa1c0ae3 tempest-SnapshotDependencyTests-623161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:10 devstack sudo[101239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252.info Nov 02 15:42:10 devstack sudo[101239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:10 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-5b55f64c-b234-4657-9bad-4601374d47ff tempest-VolumesActionsTest-647963840 None] Created reservations ['6bc687d4-5780-4657-b12b-9c65c66e4c5e', '10f9dbb5-39ed-44c1-aa75-f30e6aca9bc0', 'ee75e2ca-d095-4e5e-8f03-dad22ae5bbf3', '43aa2f80-0989-4c05-85e7-53da4d845f87'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:42:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5b55f64c-b234-4657-9bad-4601374d47ff tempest-VolumesActionsTest-647963840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:42:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5b55f64c-b234-4657-9bad-4601374d47ff tempest-VolumesActionsTest-647963840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-5b55f64c-b234-4657-9bad-4601374d47ff tempest-VolumesActionsTest-647963840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:42:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-5b55f64c-b234-4657-9bad-4601374d47ff tempest-VolumesActionsTest-647963840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:42:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5b55f64c-b234-4657-9bad-4601374d47ff tempest-VolumesActionsTest-647963840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5b55f64c-b234-4657-9bad-4601374d47ff tempest-VolumesActionsTest-647963840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:10 devstack sudo[101241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:42:10 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:10 devstack sudo[101239]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a1639b61-41b3-4028-aa19-669bfa1c0ae3 tempest-SnapshotDependencyTests-623161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252.info" returned: 0 in 0.261s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a1639b61-41b3-4028-aa19-669bfa1c0ae3 tempest-SnapshotDependencyTests-623161192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.031s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-c6e29faa-ec09-45e4-859b-f879146a61d5 req-aaad6f76-8180-40bb-9fe4-be791f7d3075 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 10.392s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-c6e29faa-ec09-45e4-859b-f879146a61d5 req-aaad6f76-8180-40bb-9fe4-be791f7d3075 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.472s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-296083826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=396b1f2b-7af7-4af5-a7c4-c0f5021dd0d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c502b240ce44a4a8c3287630e76227f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:42:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:42:02Z,use_quota=True,user_id='843ab47c94ac47b68c4bf8de40ebe1d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:42:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] Creating volume 396b1f2b-7af7-4af5-a7c4-c0f5021dd0d3 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:42:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:42:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:42:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:42:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:42:10 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:42:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-396b1f2b-7af7-4af5-a7c4-c0f5021dd0d3 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:10 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-a1639b61-41b3-4028-aa19-669bfa1c0ae3 tempest-SnapshotDependencyTests-623161192 None] Create snapshot completed successfully Nov 02 15:42:10 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:10 devstack sudo[101245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-396b1f2b-7af7-4af5-a7c4-c0f5021dd0d3 1073741824 Nov 02 15:42:10 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5b55f64c-b234-4657-9bad-4601374d47ff tempest-VolumesActionsTest-647963840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.293s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:10 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-5b55f64c-b234-4657-9bad-4601374d47ff tempest-VolumesActionsTest-647963840 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:42:10 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-5b55f64c-b234-4657-9bad-4601374d47ff tempest-VolumesActionsTest-647963840 None] Deleted volume successfully. Nov 02 15:42:11 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5b55f64c-b234-4657-9bad-4601374d47ff tempest-VolumesActionsTest-647963840 None] Lock "cinder-d70dd375-0520-4fbc-8a75-289fd422efc3-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:42:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-c6e29faa-ec09-45e4-859b-f879146a61d5 req-aaad6f76-8180-40bb-9fe4-be791f7d3075 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478', 'name': 'volume-7c314237-4dc8-46d1-86ee-2349f60f959b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '91f143b0-ab54-4993-8589-b315660d8c29', 'enforce_multipath': True} {{(pid=86703) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 15:42:11 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-c6e29faa-ec09-45e4-859b-f879146a61d5 req-aaad6f76-8180-40bb-9fe4-be791f7d3075 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] attachment_update completed successfully. Nov 02 15:42:11 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-396b1f2b-7af7-4af5-a7c4-c0f5021dd0d3 1073741824" returned: 0 in 0.608s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-396b1f2b-7af7-4af5-a7c4-c0f5021dd0d3 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:11 devstack sudo[101351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-396b1f2b-7af7-4af5-a7c4-c0f5021dd0d3 Nov 02 15:42:11 devstack sudo[101351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:12 devstack sudo[101351]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-396b1f2b-7af7-4af5-a7c4-c0f5021dd0d3" returned: 0 in 0.439s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a57c7978-74fc-49a9-8255-57ac794a03de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-396b1f2b-7af7-4af5-a7c4-c0f5021dd0d3', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba1bd42-6529-42ed-b364-ac4a32249469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Flow 'volume_create_manager' (9c024106-7ad5-4f0e-b28e-db2535f35a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d76741-b3ba-4bb4-a47f-7663545783c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:12 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] Volume volume-396b1f2b-7af7-4af5-a7c4-c0f5021dd0d3 (396b1f2b-7af7-4af5-a7c4-c0f5021dd0d3): created successfully Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ba1bd42-6529-42ed-b364-ac4a32249469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] Flow 'volume_create_manager' (4625423b-cf9d-4d34-ac60-7c4435108ae5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d76741-b3ba-4bb4-a47f-7663545783c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:42:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fadbb1d-2146-46ab-8d20-e2824ba1056b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2696f990f0a144eb970b5fec6bdfebb2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:42:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=644729f2-22ba-4488-8120-49c6a345a0df,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:42:12Z,use_quota=True,user_id='5056b280b7ad4d21b99178231bc20917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27654dcf-62cf-4be4-a96e-3bcf2204cf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27654dcf-62cf-4be4-a96e-3bcf2204cf91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d141305-5443-4203-940e-ac3694f06243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d141305-5443-4203-940e-ac3694f06243) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2fadbb1d-2146-46ab-8d20-e2824ba1056b', 'volume_name': 'volume-2fadbb1d-2146-46ab-8d20-e2824ba1056b', 'volume_size': 1, 'snapshot_id': '644729f2-22ba-4488-8120-49c6a345a0df'}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eea84f0-6dc5-4330-9bf0-66f4a5ebed21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eea84f0-6dc5-4330-9bf0-66f4a5ebed21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1abe3e27-d0cd-4778-9505-044997e4cc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:12 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Volume 2fadbb1d-2146-46ab-8d20-e2824ba1056b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2fadbb1d-2146-46ab-8d20-e2824ba1056b', 'volume_size': 1, 'snapshot_id': '644729f2-22ba-4488-8120-49c6a345a0df'} Nov 02 15:42:12 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-03926814-f4c1-4760-8f1e-104d9cdb8733 tempest-VolumesTransfersV355Test-868307679 None] Created volume successfully. Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Acquiring lock "cinder-quobyte-644729f2-22ba-4488-8120-49c6a345a0df-2fadbb1d-2146-46ab-8d20-e2824ba1056b" by "_create_volume_from_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Lock "cinder-quobyte-644729f2-22ba-4488-8120-49c6a345a0df-2fadbb1d-2146-46ab-8d20-e2824ba1056b" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Creating volume 2fadbb1d-2146-46ab-8d20-e2824ba1056b from snapshot 644729f2-22ba-4488-8120-49c6a345a0df {{(pid=86703) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Acquiring lock "cinder-quobyte-2fadbb1d-2146-46ab-8d20-e2824ba1056b" by "_copy_volume_from_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Lock "cinder-quobyte-2fadbb1d-2146-46ab-8d20-e2824ba1056b" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] snapshot: 644729f2-22ba-4488-8120-49c6a345a0df, volume: 2fadbb1d-2146-46ab-8d20-e2824ba1056b, {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[808f0aee-11bf-4cb3-b715-0beac9b53a12]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252.644729f2-22ba-4488-8120-49c6a345a0df {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:12 devstack sudo[101677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252.644729f2-22ba-4488-8120-49c6a345a0df Nov 02 15:42:12 devstack sudo[101677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:12 devstack sudo[101677]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252.644729f2-22ba-4488-8120-49c6a345a0df" returned: 0 in 0.466s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e176a3f-349b-47f7-98e7-553910275252(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb82c93-16b1-4684-8901-1236628b5ec1]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:42:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:13 devstack sudo[101682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252 Nov 02 15:42:13 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:13 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252" returned: 0 in 0.559s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:13 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] will copy from snapshot at /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252 {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 15:42:13 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Creating direct copy from snapshot {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 15:42:13 devstack cinder-volume[86703]: DEBUG cinder.utils [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Path /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2fadbb1d-2146-46ab-8d20-e2824ba1056b not found in is_blk_device check {{(pid=86703) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 15:42:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2fadbb1d-2146-46ab-8d20-e2824ba1056b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:13 devstack sudo[101689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2fadbb1d-2146-46ab-8d20-e2824ba1056b Nov 02 15:42:13 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:13 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-46daee2a-1470-4946-ab16-6c6b9860b8c5 tempest-VolumesTransfersV355Test-95385185 None] Acquiring lock "cinder-396b1f2b-7af7-4af5-a7c4-c0f5021dd0d3-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:42:13 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-46daee2a-1470-4946-ab16-6c6b9860b8c5 tempest-VolumesTransfersV355Test-95385185 None] Lock "cinder-396b1f2b-7af7-4af5-a7c4-c0f5021dd0d3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:42:13 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-46daee2a-1470-4946-ab16-6c6b9860b8c5 tempest-VolumesTransfersV355Test-95385185 None] Acquiring lock "cinder-quobyte-396b1f2b-7af7-4af5-a7c4-c0f5021dd0d3" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:42:13 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-46daee2a-1470-4946-ab16-6c6b9860b8c5 tempest-VolumesTransfersV355Test-95385185 None] Lock "cinder-quobyte-396b1f2b-7af7-4af5-a7c4-c0f5021dd0d3" acquired by "delete_volume" :: waited 0.026s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:42:13 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[df72b3d7-7ce2-4c01-a89c-4e0abf8c6d07]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:42:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-46daee2a-1470-4946-ab16-6c6b9860b8c5 tempest-VolumesTransfersV355Test-95385185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-396b1f2b-7af7-4af5-a7c4-c0f5021dd0d3 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:14 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-396b1f2b-7af7-4af5-a7c4-c0f5021dd0d3 Nov 02 15:42:14 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:14 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-46daee2a-1470-4946-ab16-6c6b9860b8c5 tempest-VolumesTransfersV355Test-95385185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-396b1f2b-7af7-4af5-a7c4-c0f5021dd0d3" returned: 0 in 0.729s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-46daee2a-1470-4946-ab16-6c6b9860b8c5 tempest-VolumesTransfersV355Test-95385185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-396b1f2b-7af7-4af5-a7c4-c0f5021dd0d3 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:14 devstack sudo[101707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-396b1f2b-7af7-4af5-a7c4-c0f5021dd0d3 Nov 02 15:42:14 devstack sudo[101707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:15 devstack sudo[101707]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-46daee2a-1470-4946-ab16-6c6b9860b8c5 tempest-VolumesTransfersV355Test-95385185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-396b1f2b-7af7-4af5-a7c4-c0f5021dd0d3" returned: 0 in 0.624s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:15 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-46daee2a-1470-4946-ab16-6c6b9860b8c5 tempest-VolumesTransfersV355Test-95385185 None] Lock "cinder-quobyte-396b1f2b-7af7-4af5-a7c4-c0f5021dd0d3" released by "delete_volume" :: held 1.459s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:42:15 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-46daee2a-1470-4946-ab16-6c6b9860b8c5 tempest-VolumesTransfersV355Test-95385185 None] Created reservations ['23e91aca-0de7-447b-95c9-4aa3cf7a66a6', '5fcace88-5a5a-4c57-87d0-0d09565c2248', '63b4b88e-b56e-4d09-8dd9-5c20680030a3', '88fb65a1-4e2a-41ff-93ec-c1959a178936'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:42:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-46daee2a-1470-4946-ab16-6c6b9860b8c5 tempest-VolumesTransfersV355Test-95385185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:42:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-46daee2a-1470-4946-ab16-6c6b9860b8c5 tempest-VolumesTransfersV355Test-95385185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:15 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-46daee2a-1470-4946-ab16-6c6b9860b8c5 tempest-VolumesTransfersV355Test-95385185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:42:15 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-46daee2a-1470-4946-ab16-6c6b9860b8c5 tempest-VolumesTransfersV355Test-95385185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:42:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-46daee2a-1470-4946-ab16-6c6b9860b8c5 tempest-VolumesTransfersV355Test-95385185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-46daee2a-1470-4946-ab16-6c6b9860b8c5 tempest-VolumesTransfersV355Test-95385185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:15 devstack sudo[101738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:42:15 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:15 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-f476e9c4-4c18-4e90-87ca-a38d03f194c1 req-45749bb6-a6d0-46e9-805c-6fccab3c3a05 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Terminate volume connection completed successfully. Nov 02 15:42:15 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-f476e9c4-4c18-4e90-87ca-a38d03f194c1 req-45749bb6-a6d0-46e9-805c-6fccab3c3a05 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Deleting attachment 91f143b0-ab54-4993-8589-b315660d8c29. {{(pid=86703) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 15:42:16 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-46daee2a-1470-4946-ab16-6c6b9860b8c5 tempest-VolumesTransfersV355Test-95385185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.583s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:16 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-46daee2a-1470-4946-ab16-6c6b9860b8c5 tempest-VolumesTransfersV355Test-95385185 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:42:16 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-46daee2a-1470-4946-ab16-6c6b9860b8c5 tempest-VolumesTransfersV355Test-95385185 None] Deleted volume successfully. Nov 02 15:42:16 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-46daee2a-1470-4946-ab16-6c6b9860b8c5 tempest-VolumesTransfersV355Test-95385185 None] Lock "cinder-396b1f2b-7af7-4af5-a7c4-c0f5021dd0d3-delete_volume" released by "delete_volume" :: held 2.568s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:42:17 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b807bfab-1081-42a6-a3c2-d0bcd08bb923 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Acquiring lock "cinder-7c314237-4dc8-46d1-86ee-2349f60f959b-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:42:17 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b807bfab-1081-42a6-a3c2-d0bcd08bb923 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Lock "cinder-7c314237-4dc8-46d1-86ee-2349f60f959b-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:42:17 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b807bfab-1081-42a6-a3c2-d0bcd08bb923 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Acquiring lock "cinder-quobyte-7c314237-4dc8-46d1-86ee-2349f60f959b" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:42:17 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b807bfab-1081-42a6-a3c2-d0bcd08bb923 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Lock "cinder-quobyte-7c314237-4dc8-46d1-86ee-2349f60f959b" acquired by "delete_volume" :: waited 0.029s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:42:17 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fce333a-abf0-4587-b169-8cda78d65b6f]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:42:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b807bfab-1081-42a6-a3c2-d0bcd08bb923 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7c314237-4dc8-46d1-86ee-2349f60f959b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:18 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7c314237-4dc8-46d1-86ee-2349f60f959b Nov 02 15:42:18 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:18 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b807bfab-1081-42a6-a3c2-d0bcd08bb923 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7c314237-4dc8-46d1-86ee-2349f60f959b" returned: 0 in 0.787s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b807bfab-1081-42a6-a3c2-d0bcd08bb923 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7c314237-4dc8-46d1-86ee-2349f60f959b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:18 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7c314237-4dc8-46d1-86ee-2349f60f959b Nov 02 15:42:18 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:19 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b807bfab-1081-42a6-a3c2-d0bcd08bb923 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7c314237-4dc8-46d1-86ee-2349f60f959b" returned: 0 in 0.546s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:19 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b807bfab-1081-42a6-a3c2-d0bcd08bb923 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Lock "cinder-quobyte-7c314237-4dc8-46d1-86ee-2349f60f959b" released by "delete_volume" :: held 1.432s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:42:19 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-b807bfab-1081-42a6-a3c2-d0bcd08bb923 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Created reservations ['4d5941b1-b702-46a7-a4f1-a76b9c392115', '3f392e20-3a26-4e75-a082-86b71fe7afc4', '7a531832-5249-41ac-b696-ef3c8c331347', '2798953d-81ca-4348-b0aa-aa765c2a6b27'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:42:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b807bfab-1081-42a6-a3c2-d0bcd08bb923 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:42:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b807bfab-1081-42a6-a3c2-d0bcd08bb923 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:19 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b807bfab-1081-42a6-a3c2-d0bcd08bb923 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:42:19 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b807bfab-1081-42a6-a3c2-d0bcd08bb923 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:42:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b807bfab-1081-42a6-a3c2-d0bcd08bb923 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b807bfab-1081-42a6-a3c2-d0bcd08bb923 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:19 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:42:19 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:19 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b807bfab-1081-42a6-a3c2-d0bcd08bb923 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.390s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:19 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-b807bfab-1081-42a6-a3c2-d0bcd08bb923 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:42:19 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-b807bfab-1081-42a6-a3c2-d0bcd08bb923 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Deleted volume successfully. Nov 02 15:42:19 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b807bfab-1081-42a6-a3c2-d0bcd08bb923 tempest-TestServerVolumeAttachScenarioOldVersion-907200726 None] Lock "cinder-7c314237-4dc8-46d1-86ee-2349f60f959b-delete_volume" released by "delete_volume" :: held 2.254s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:42:20 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:42:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:42:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:42:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:42:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:20 devstack sudo[101756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:42:20 devstack sudo[101756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:21 devstack sudo[101756]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.984s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:21 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:42:21 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager._thread_info {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:42:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread count: 29 {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 15:42:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread info: [<_MainThread(MainThread, started 125876361756800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 15:42:23 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2fadbb1d-2146-46ab-8d20-e2824ba1056b" returned: 0 in 10.465s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:23 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Image conversion details: src /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252, size 1024.00 MB, duration 10.47 sec, destination /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2fadbb1d-2146-46ab-8d20-e2824ba1056b {{(pid=86703) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 15:42:23 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Converted 1024.00 MB image at 97.84 MB/s Nov 02 15:42:23 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2fadbb1d-2146-46ab-8d20-e2824ba1056b is being set with open permissions: ugo+rw Nov 02 15:42:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2fadbb1d-2146-46ab-8d20-e2824ba1056b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:24 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2fadbb1d-2146-46ab-8d20-e2824ba1056b Nov 02 15:42:24 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:24 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2fadbb1d-2146-46ab-8d20-e2824ba1056b" returned: 0 in 0.417s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:24 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Lock "cinder-quobyte-2fadbb1d-2146-46ab-8d20-e2824ba1056b" released by "_copy_volume_from_snapshot" :: held 12.041s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:42:24 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Lock "cinder-quobyte-644729f2-22ba-4488-8120-49c6a345a0df-2fadbb1d-2146-46ab-8d20-e2824ba1056b" released by "_create_volume_from_snapshot" :: held 12.125s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:42:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.151s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1abe3e27-d0cd-4778-9505-044997e4cc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fadbb1d-2146-46ab-8d20-e2824ba1056b', 'volume_size': 1, 'snapshot_id': '644729f2-22ba-4488-8120-49c6a345a0df'}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1378fc81-29d5-42e6-ad25-747e9179d90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:24 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Volume volume-2fadbb1d-2146-46ab-8d20-e2824ba1056b (2fadbb1d-2146-46ab-8d20-e2824ba1056b): created successfully Nov 02 15:42:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1378fc81-29d5-42e6-ad25-747e9179d90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Flow 'volume_create_manager' (9c024106-7ad5-4f0e-b28e-db2535f35a5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:42:24 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-55fb9a7a-fbd8-4fb2-a0a2-dca0de2d4bd0 tempest-SnapshotDependencyTests-623161192 None] Created volume successfully. Nov 02 15:42:25 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-30ecf006-8e9a-4940-802b-0db7e1794a73 tempest-SnapshotDependencyTests-623161192 None] Acquiring lock "cinder-644729f2-22ba-4488-8120-49c6a345a0df-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:42:25 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-30ecf006-8e9a-4940-802b-0db7e1794a73 tempest-SnapshotDependencyTests-623161192 None] Lock "cinder-644729f2-22ba-4488-8120-49c6a345a0df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:42:25 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-30ecf006-8e9a-4940-802b-0db7e1794a73 tempest-SnapshotDependencyTests-623161192 None] Acquiring lock "cinder-quobyte-2e176a3f-349b-47f7-98e7-553910275252" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:42:25 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-30ecf006-8e9a-4940-802b-0db7e1794a73 tempest-SnapshotDependencyTests-623161192 None] Lock "cinder-quobyte-2e176a3f-349b-47f7-98e7-553910275252" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:42:25 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-30ecf006-8e9a-4940-802b-0db7e1794a73 tempest-SnapshotDependencyTests-623161192 None] Acquiring lock "cinder-quobyte-644729f2-22ba-4488-8120-49c6a345a0df" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:42:25 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-30ecf006-8e9a-4940-802b-0db7e1794a73 tempest-SnapshotDependencyTests-623161192 None] Lock "cinder-quobyte-644729f2-22ba-4488-8120-49c6a345a0df" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:42:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-30ecf006-8e9a-4940-802b-0db7e1794a73 tempest-SnapshotDependencyTests-623161192 None] Deleting offline snapshot 644729f2-22ba-4488-8120-49c6a345a0df of volume 2e176a3f-349b-47f7-98e7-553910275252 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:42:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-30ecf006-8e9a-4940-802b-0db7e1794a73 tempest-SnapshotDependencyTests-623161192 None] snapshot_file for this snap is: volume-2e176a3f-349b-47f7-98e7-553910275252.644729f2-22ba-4488-8120-49c6a345a0df {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:42:25 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aeb8933-77f7-42f4-b812-250b6bac842c]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:42:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-30ecf006-8e9a-4940-802b-0db7e1794a73 tempest-SnapshotDependencyTests-623161192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252.644729f2-22ba-4488-8120-49c6a345a0df {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:25 devstack sudo[101785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252.644729f2-22ba-4488-8120-49c6a345a0df Nov 02 15:42:25 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:26 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-30ecf006-8e9a-4940-802b-0db7e1794a73 tempest-SnapshotDependencyTests-623161192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252.644729f2-22ba-4488-8120-49c6a345a0df" returned: 0 in 0.452s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-30ecf006-8e9a-4940-802b-0db7e1794a73 tempest-SnapshotDependencyTests-623161192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e176a3f-349b-47f7-98e7-553910275252(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:42:26 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[779cb7a9-2b2b-4ce9-87c4-916ab6094d7e]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:42:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-30ecf006-8e9a-4940-802b-0db7e1794a73 tempest-SnapshotDependencyTests-623161192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:26 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252 Nov 02 15:42:26 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:26 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-30ecf006-8e9a-4940-802b-0db7e1794a73 tempest-SnapshotDependencyTests-623161192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252" returned: 0 in 0.698s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-30ecf006-8e9a-4940-802b-0db7e1794a73 tempest-SnapshotDependencyTests-623161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252.644729f2-22ba-4488-8120-49c6a345a0df {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:26 devstack sudo[101796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252.644729f2-22ba-4488-8120-49c6a345a0df Nov 02 15:42:26 devstack sudo[101796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:27 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:42:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] Flow 'volume_create_manager' (47e895ec-e193-479d-bd8a-0cefe2b88c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:42:27 devstack sudo[101796]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ed2ada-76cf-460f-8340-22169b378fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-30ecf006-8e9a-4940-802b-0db7e1794a73 tempest-SnapshotDependencyTests-623161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252.644729f2-22ba-4488-8120-49c6a345a0df" returned: 0 in 0.452s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-30ecf006-8e9a-4940-802b-0db7e1794a73 tempest-SnapshotDependencyTests-623161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252.644729f2-22ba-4488-8120-49c6a345a0df {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:27 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252.644729f2-22ba-4488-8120-49c6a345a0df Nov 02 15:42:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ed2ada-76cf-460f-8340-22169b378fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1296877248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b39f21-5bf5-47ee-b8fd-ad54e2e36b4a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e8d704b8acea42669f54bf4850039cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:42:27Z,use_quota=True,user_id='f00e846dab1a4cfcb99f544db61cdcfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:27 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (346374f7-4121-4815-a483-0defb24a5781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (346374f7-4121-4815-a483-0defb24a5781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7491f226-4715-45d8-a03c-62a80b39f5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7491f226-4715-45d8-a03c-62a80b39f5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08b39f21-5bf5-47ee-b8fd-ad54e2e36b4a', 'volume_name': 'volume-08b39f21-5bf5-47ee-b8fd-ad54e2e36b4a', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f188a42-b1cf-4a4b-8bdb-e7f002b063ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f188a42-b1cf-4a4b-8bdb-e7f002b063ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ecbd6db-d8ab-488b-9640-2f7ed7780d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:27 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] Volume 08b39f21-5bf5-47ee-b8fd-ad54e2e36b4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08b39f21-5bf5-47ee-b8fd-ad54e2e36b4a', 'volume_size': 1} Nov 02 15:42:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:42:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:27 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1296877248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b39f21-5bf5-47ee-b8fd-ad54e2e36b4a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e8d704b8acea42669f54bf4850039cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:42:27Z,use_quota=True,user_id='f00e846dab1a4cfcb99f544db61cdcfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:42:27 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] Creating volume 08b39f21-5bf5-47ee-b8fd-ad54e2e36b4a {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:42:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:42:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:27 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:42:27 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:42:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:27 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:42:27 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:42:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-08b39f21-5bf5-47ee-b8fd-ad54e2e36b4a 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:27 devstack sudo[101804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-08b39f21-5bf5-47ee-b8fd-ad54e2e36b4a 1073741824 Nov 02 15:42:27 devstack sudo[101804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:27 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-30ecf006-8e9a-4940-802b-0db7e1794a73 tempest-SnapshotDependencyTests-623161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252.644729f2-22ba-4488-8120-49c6a345a0df" returned: 0 in 0.308s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-30ecf006-8e9a-4940-802b-0db7e1794a73 tempest-SnapshotDependencyTests-623161192 None] Lock "cinder-quobyte-644729f2-22ba-4488-8120-49c6a345a0df" released by "_delete_snapshot" :: held 2.096s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:42:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-30ecf006-8e9a-4940-802b-0db7e1794a73 tempest-SnapshotDependencyTests-623161192 None] Lock "cinder-quobyte-2e176a3f-349b-47f7-98e7-553910275252" released by "delete_snapshot" :: held 2.126s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:42:27 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-30ecf006-8e9a-4940-802b-0db7e1794a73 tempest-SnapshotDependencyTests-623161192 None] Created reservations ['8430e0fe-a9cc-4290-8bb1-3af36daad9c9', '3c237863-5f35-4461-9811-6362fd8097cb', 'a1507537-14be-416e-9502-726aeab47995', '12fe3316-60dc-40a8-aa9e-72627d2a6ba1'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:42:27 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-30ecf006-8e9a-4940-802b-0db7e1794a73 tempest-SnapshotDependencyTests-623161192 None] Delete snapshot completed successfully. Nov 02 15:42:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-30ecf006-8e9a-4940-802b-0db7e1794a73 tempest-SnapshotDependencyTests-623161192 None] Lock "cinder-644729f2-22ba-4488-8120-49c6a345a0df-delete_snapshot" released by "delete_snapshot" :: held 2.326s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:42:27 devstack sudo[101804]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-08b39f21-5bf5-47ee-b8fd-ad54e2e36b4a 1073741824" returned: 0 in 0.537s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-08b39f21-5bf5-47ee-b8fd-ad54e2e36b4a {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:28 devstack sudo[101812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-08b39f21-5bf5-47ee-b8fd-ad54e2e36b4a Nov 02 15:42:28 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:28 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-08b39f21-5bf5-47ee-b8fd-ad54e2e36b4a" returned: 0 in 0.343s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:42:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ecbd6db-d8ab-488b-9640-2f7ed7780d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08b39f21-5bf5-47ee-b8fd-ad54e2e36b4a', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b844678f-eec6-42c3-924d-93a7800440ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:28 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] Volume volume-08b39f21-5bf5-47ee-b8fd-ad54e2e36b4a (08b39f21-5bf5-47ee-b8fd-ad54e2e36b4a): created successfully Nov 02 15:42:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b844678f-eec6-42c3-924d-93a7800440ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] Flow 'volume_create_manager' (47e895ec-e193-479d-bd8a-0cefe2b88c63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:42:28 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-17c60f66-adc4-4c13-b113-bf1ede813163 tempest-VolumesGetTest-361458807 None] Created volume successfully. Nov 02 15:42:28 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-864d87f9-4879-414b-baaf-81ff900eb8f7 tempest-SnapshotDependencyTests-623161192 None] Acquiring lock "cinder-2e176a3f-349b-47f7-98e7-553910275252-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:42:28 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-864d87f9-4879-414b-baaf-81ff900eb8f7 tempest-SnapshotDependencyTests-623161192 None] Lock "cinder-2e176a3f-349b-47f7-98e7-553910275252-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:42:28 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-864d87f9-4879-414b-baaf-81ff900eb8f7 tempest-SnapshotDependencyTests-623161192 None] Acquiring lock "cinder-quobyte-2e176a3f-349b-47f7-98e7-553910275252" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:42:28 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-864d87f9-4879-414b-baaf-81ff900eb8f7 tempest-SnapshotDependencyTests-623161192 None] Lock "cinder-quobyte-2e176a3f-349b-47f7-98e7-553910275252" acquired by "delete_volume" :: waited 0.031s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:42:28 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8977791-b3f7-4c00-9fa8-8b30c4bbf4b5]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:42:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-864d87f9-4879-414b-baaf-81ff900eb8f7 tempest-SnapshotDependencyTests-623161192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:29 devstack sudo[101816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252 Nov 02 15:42:29 devstack sudo[101816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:29 devstack sudo[101816]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-864d87f9-4879-414b-baaf-81ff900eb8f7 tempest-SnapshotDependencyTests-623161192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252" returned: 0 in 0.497s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-864d87f9-4879-414b-baaf-81ff900eb8f7 tempest-SnapshotDependencyTests-623161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:29 devstack sudo[101821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252 Nov 02 15:42:29 devstack sudo[101821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:29 devstack sudo[101821]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-864d87f9-4879-414b-baaf-81ff900eb8f7 tempest-SnapshotDependencyTests-623161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2e176a3f-349b-47f7-98e7-553910275252" returned: 0 in 0.367s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:29 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-864d87f9-4879-414b-baaf-81ff900eb8f7 tempest-SnapshotDependencyTests-623161192 None] Lock "cinder-quobyte-2e176a3f-349b-47f7-98e7-553910275252" released by "delete_volume" :: held 0.948s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:42:29 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-864d87f9-4879-414b-baaf-81ff900eb8f7 tempest-SnapshotDependencyTests-623161192 None] Created reservations ['aec1d030-0c29-462c-8f9f-5bed6215e607', 'cc165971-d57a-400c-9cc3-0a8493ada16b', 'ca51234d-b016-4c02-996f-c071e07d8e00', '17a8537a-eaa2-4140-8e4c-2d901a245c12'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:42:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-864d87f9-4879-414b-baaf-81ff900eb8f7 tempest-SnapshotDependencyTests-623161192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:42:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-864d87f9-4879-414b-baaf-81ff900eb8f7 tempest-SnapshotDependencyTests-623161192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-864d87f9-4879-414b-baaf-81ff900eb8f7 tempest-SnapshotDependencyTests-623161192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:42:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-864d87f9-4879-414b-baaf-81ff900eb8f7 tempest-SnapshotDependencyTests-623161192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:42:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-864d87f9-4879-414b-baaf-81ff900eb8f7 tempest-SnapshotDependencyTests-623161192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-864d87f9-4879-414b-baaf-81ff900eb8f7 tempest-SnapshotDependencyTests-623161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:30 devstack sudo[101824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:42:30 devstack sudo[101824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:30 devstack sudo[101824]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-864d87f9-4879-414b-baaf-81ff900eb8f7 tempest-SnapshotDependencyTests-623161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.359s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:30 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-864d87f9-4879-414b-baaf-81ff900eb8f7 tempest-SnapshotDependencyTests-623161192 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:42:30 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-864d87f9-4879-414b-baaf-81ff900eb8f7 tempest-SnapshotDependencyTests-623161192 None] Deleted volume successfully. Nov 02 15:42:30 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-864d87f9-4879-414b-baaf-81ff900eb8f7 tempest-SnapshotDependencyTests-623161192 None] Lock "cinder-2e176a3f-349b-47f7-98e7-553910275252-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:42:30 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:42:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] Flow 'volume_create_manager' (2892b140-d1f6-49e9-8268-e801b805c366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:42:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f95896-6d95-4a1a-8c28-821929412970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21f95896-6d95-4a1a-8c28-821929412970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:42:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1194736273',display_name='tempest-VolumesGetTest-Volume-1150201480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aab9133-df96-42c6-b7c5-8fb9776d62bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8d704b8acea42669f54bf4850039cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:42:31Z,use_quota=True,user_id='f00e846dab1a4cfcb99f544db61cdcfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d041c08a-f814-4dac-b235-6dd3f8af1ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d041c08a-f814-4dac-b235-6dd3f8af1ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (061d404c-6fc0-4eab-8580-64a3c007f65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (061d404c-6fc0-4eab-8580-64a3c007f65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8aab9133-df96-42c6-b7c5-8fb9776d62bd', 'volume_name': 'volume-8aab9133-df96-42c6-b7c5-8fb9776d62bd', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cefa8de-5926-4ef3-b1e5-d969f6f20c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cefa8de-5926-4ef3-b1e5-d969f6f20c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf7a9daa-b0f6-479c-b65a-b1431f1ff555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:30 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] Volume 8aab9133-df96-42c6-b7c5-8fb9776d62bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8aab9133-df96-42c6-b7c5-8fb9776d62bd', 'volume_size': 1} Nov 02 15:42:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:42:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:42:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1194736273',display_name='tempest-VolumesGetTest-Volume-1150201480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aab9133-df96-42c6-b7c5-8fb9776d62bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8d704b8acea42669f54bf4850039cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:42:31Z,use_quota=True,user_id='f00e846dab1a4cfcb99f544db61cdcfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:42:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] Creating volume 8aab9133-df96-42c6-b7c5-8fb9776d62bd {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:42:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:42:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:42:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:42:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:42:30 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:42:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8aab9133-df96-42c6-b7c5-8fb9776d62bd 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:30 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8aab9133-df96-42c6-b7c5-8fb9776d62bd 1073741824 Nov 02 15:42:30 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-441b5dc3-7f09-42c9-acbe-12514b308399 tempest-SnapshotDependencyTests-623161192 None] Acquiring lock "cinder-2fadbb1d-2146-46ab-8d20-e2824ba1056b-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-441b5dc3-7f09-42c9-acbe-12514b308399 tempest-SnapshotDependencyTests-623161192 None] Lock "cinder-2fadbb1d-2146-46ab-8d20-e2824ba1056b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-441b5dc3-7f09-42c9-acbe-12514b308399 tempest-SnapshotDependencyTests-623161192 None] Acquiring lock "cinder-quobyte-2fadbb1d-2146-46ab-8d20-e2824ba1056b" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-441b5dc3-7f09-42c9-acbe-12514b308399 tempest-SnapshotDependencyTests-623161192 None] Lock "cinder-quobyte-2fadbb1d-2146-46ab-8d20-e2824ba1056b" acquired by "delete_volume" :: waited 0.017s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e69363f-246f-4a16-85e5-abf11c8daac5]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-441b5dc3-7f09-42c9-acbe-12514b308399 tempest-SnapshotDependencyTests-623161192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2fadbb1d-2146-46ab-8d20-e2824ba1056b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:31 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] Flow 'volume_create_manager' (24edf3d9-c799-4f94-bb60-6b96ca41cb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa73b8a-a681-4c8d-a5e8-d39d5abb4ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8aab9133-df96-42c6-b7c5-8fb9776d62bd 1073741824" returned: 0 in 0.627s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:31 devstack sudo[101832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2fadbb1d-2146-46ab-8d20-e2824ba1056b Nov 02 15:42:31 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caa73b8a-a681-4c8d-a5e8-d39d5abb4ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-544834907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd2ccd6a-516b-4ce6-b4d7-2911a7b80878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af7fa2ee547c488a833a376eeea216e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:42:31Z,use_quota=True,user_id='ec577c6a0a6b4857809f51fdc933f71d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19c6dc56-04f8-4dec-9da6-0458173295c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19c6dc56-04f8-4dec-9da6-0458173295c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e368ced9-2a02-475d-9fe3-3800632a093e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e368ced9-2a02-475d-9fe3-3800632a093e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd2ccd6a-516b-4ce6-b4d7-2911a7b80878', 'volume_name': 'volume-cd2ccd6a-516b-4ce6-b4d7-2911a7b80878', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad203fbc-0c4a-49fd-a04b-75be64e8d307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad203fbc-0c4a-49fd-a04b-75be64e8d307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bccecece-87ce-441a-a753-efa16a46f6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:31 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] Volume cd2ccd6a-516b-4ce6-b4d7-2911a7b80878: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd2ccd6a-516b-4ce6-b4d7-2911a7b80878', 'volume_size': 1} Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8aab9133-df96-42c6-b7c5-8fb9776d62bd {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:31 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8aab9133-df96-42c6-b7c5-8fb9776d62bd Nov 02 15:42:31 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:31 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-441b5dc3-7f09-42c9-acbe-12514b308399 tempest-SnapshotDependencyTests-623161192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2fadbb1d-2146-46ab-8d20-e2824ba1056b" returned: 0 in 0.499s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-441b5dc3-7f09-42c9-acbe-12514b308399 tempest-SnapshotDependencyTests-623161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2fadbb1d-2146-46ab-8d20-e2824ba1056b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:31 devstack sudo[101843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2fadbb1d-2146-46ab-8d20-e2824ba1056b Nov 02 15:42:31 devstack sudo[101843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:31 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8aab9133-df96-42c6-b7c5-8fb9776d62bd" returned: 0 in 0.339s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.405s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:42:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-544834907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd2ccd6a-516b-4ce6-b4d7-2911a7b80878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af7fa2ee547c488a833a376eeea216e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:42:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:42:31Z,use_quota=True,user_id='ec577c6a0a6b4857809f51fdc933f71d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] Creating volume cd2ccd6a-516b-4ce6-b4d7-2911a7b80878 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:42:31 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-cd2ccd6a-516b-4ce6-b4d7-2911a7b80878 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf7a9daa-b0f6-479c-b65a-b1431f1ff555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aab9133-df96-42c6-b7c5-8fb9776d62bd', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7be623a-d537-4ae6-81ad-1f91c6678323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:31 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-cd2ccd6a-516b-4ce6-b4d7-2911a7b80878 1073741824 Nov 02 15:42:31 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:31 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] Volume volume-8aab9133-df96-42c6-b7c5-8fb9776d62bd (8aab9133-df96-42c6-b7c5-8fb9776d62bd): created successfully Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7be623a-d537-4ae6-81ad-1f91c6678323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] Flow 'volume_create_manager' (2892b140-d1f6-49e9-8268-e801b805c366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:42:31 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-24b8cbde-236a-49c0-948b-34a323e63862 tempest-VolumesGetTest-361458807 None] Created volume successfully. Nov 02 15:42:32 devstack sudo[101843]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-441b5dc3-7f09-42c9-acbe-12514b308399 tempest-SnapshotDependencyTests-623161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2fadbb1d-2146-46ab-8d20-e2824ba1056b" returned: 0 in 0.281s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:32 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-441b5dc3-7f09-42c9-acbe-12514b308399 tempest-SnapshotDependencyTests-623161192 None] Lock "cinder-quobyte-2fadbb1d-2146-46ab-8d20-e2824ba1056b" released by "delete_volume" :: held 0.841s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:42:32 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-441b5dc3-7f09-42c9-acbe-12514b308399 tempest-SnapshotDependencyTests-623161192 None] Created reservations ['3a5bb57b-10f8-43e7-86ed-9eb6a3476186', '12a31612-f699-4953-ae77-2490eac50722', 'd56a9270-0b9a-4a9d-b5a1-3a0b1734ed46', '603ae737-bd4f-4a2a-b72d-93e5b8d921ca'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:42:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-441b5dc3-7f09-42c9-acbe-12514b308399 tempest-SnapshotDependencyTests-623161192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:42:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-441b5dc3-7f09-42c9-acbe-12514b308399 tempest-SnapshotDependencyTests-623161192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-441b5dc3-7f09-42c9-acbe-12514b308399 tempest-SnapshotDependencyTests-623161192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:42:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-441b5dc3-7f09-42c9-acbe-12514b308399 tempest-SnapshotDependencyTests-623161192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:42:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-441b5dc3-7f09-42c9-acbe-12514b308399 tempest-SnapshotDependencyTests-623161192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-441b5dc3-7f09-42c9-acbe-12514b308399 tempest-SnapshotDependencyTests-623161192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:32 devstack sudo[101851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:42:32 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:32 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-cd2ccd6a-516b-4ce6-b4d7-2911a7b80878 1073741824" returned: 0 in 0.597s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-cd2ccd6a-516b-4ce6-b4d7-2911a7b80878 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:32 devstack sudo[101854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-cd2ccd6a-516b-4ce6-b4d7-2911a7b80878 Nov 02 15:42:32 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:32 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-441b5dc3-7f09-42c9-acbe-12514b308399 tempest-SnapshotDependencyTests-623161192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.333s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:32 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-441b5dc3-7f09-42c9-acbe-12514b308399 tempest-SnapshotDependencyTests-623161192 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:42:32 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-441b5dc3-7f09-42c9-acbe-12514b308399 tempest-SnapshotDependencyTests-623161192 None] Deleted volume successfully. Nov 02 15:42:32 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-441b5dc3-7f09-42c9-acbe-12514b308399 tempest-SnapshotDependencyTests-623161192 None] Lock "cinder-2fadbb1d-2146-46ab-8d20-e2824ba1056b-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:42:32 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-cd2ccd6a-516b-4ce6-b4d7-2911a7b80878" returned: 0 in 0.357s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:42:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bccecece-87ce-441a-a753-efa16a46f6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd2ccd6a-516b-4ce6-b4d7-2911a7b80878', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3938fcff-bfab-45f8-90a1-a6d087fb9371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:32 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] Volume volume-cd2ccd6a-516b-4ce6-b4d7-2911a7b80878 (cd2ccd6a-516b-4ce6-b4d7-2911a7b80878): created successfully Nov 02 15:42:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3938fcff-bfab-45f8-90a1-a6d087fb9371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] Flow 'volume_create_manager' (24edf3d9-c799-4f94-bb60-6b96ca41cb6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:42:32 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-ecf3ab33-478d-4151-a778-0f9f44e79dc4 tempest-VolumesTransfersV357Test-2127980712 None] Created volume successfully. Nov 02 15:42:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d3687e69-3e22-4d72-8918-1e8dca74c754 tempest-VolumesGetTest-361458807 None] Acquiring lock "cinder-8aab9133-df96-42c6-b7c5-8fb9776d62bd-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:42:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d3687e69-3e22-4d72-8918-1e8dca74c754 tempest-VolumesGetTest-361458807 None] Lock "cinder-8aab9133-df96-42c6-b7c5-8fb9776d62bd-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:42:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d3687e69-3e22-4d72-8918-1e8dca74c754 tempest-VolumesGetTest-361458807 None] Acquiring lock "cinder-quobyte-8aab9133-df96-42c6-b7c5-8fb9776d62bd" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:42:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d3687e69-3e22-4d72-8918-1e8dca74c754 tempest-VolumesGetTest-361458807 None] Lock "cinder-quobyte-8aab9133-df96-42c6-b7c5-8fb9776d62bd" acquired by "delete_volume" :: waited 0.031s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:42:33 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bc1109-79a2-4884-9e0c-32c0bc7ba104]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:42:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d3687e69-3e22-4d72-8918-1e8dca74c754 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8aab9133-df96-42c6-b7c5-8fb9776d62bd {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:33 devstack sudo[101858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8aab9133-df96-42c6-b7c5-8fb9776d62bd Nov 02 15:42:33 devstack sudo[101858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:33 devstack sudo[101858]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d3687e69-3e22-4d72-8918-1e8dca74c754 tempest-VolumesGetTest-361458807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8aab9133-df96-42c6-b7c5-8fb9776d62bd" returned: 0 in 0.531s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d3687e69-3e22-4d72-8918-1e8dca74c754 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8aab9133-df96-42c6-b7c5-8fb9776d62bd {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:33 devstack sudo[101865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8aab9133-df96-42c6-b7c5-8fb9776d62bd Nov 02 15:42:33 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:34 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d3687e69-3e22-4d72-8918-1e8dca74c754 tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8aab9133-df96-42c6-b7c5-8fb9776d62bd" returned: 0 in 0.337s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:34 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d3687e69-3e22-4d72-8918-1e8dca74c754 tempest-VolumesGetTest-361458807 None] Lock "cinder-quobyte-8aab9133-df96-42c6-b7c5-8fb9776d62bd" released by "delete_volume" :: held 0.934s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:42:34 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-d3687e69-3e22-4d72-8918-1e8dca74c754 tempest-VolumesGetTest-361458807 None] Created reservations ['ecc7466b-5466-4023-b814-48abc0391ec7', '8eaaf748-eabe-4c1f-a166-6b7e9a1068d6', '4786179d-7bae-460a-bea1-956643dbf590', '3f399d53-08ad-4a77-b49c-7a8517cbbf4c'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:42:34 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-6ae92092-c079-4b5d-a9e3-d3b1ba59e25f tempest-VolumesTransfersV357Test-1572579014 None] Transfer volume completed successfully. Nov 02 15:42:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d3687e69-3e22-4d72-8918-1e8dca74c754 tempest-VolumesGetTest-361458807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:42:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d3687e69-3e22-4d72-8918-1e8dca74c754 tempest-VolumesGetTest-361458807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:34 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d3687e69-3e22-4d72-8918-1e8dca74c754 tempest-VolumesGetTest-361458807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:42:34 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d3687e69-3e22-4d72-8918-1e8dca74c754 tempest-VolumesGetTest-361458807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:42:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d3687e69-3e22-4d72-8918-1e8dca74c754 tempest-VolumesGetTest-361458807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d3687e69-3e22-4d72-8918-1e8dca74c754 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:34 devstack sudo[101868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:42:34 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:34 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d3687e69-3e22-4d72-8918-1e8dca74c754 tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.397s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:34 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-d3687e69-3e22-4d72-8918-1e8dca74c754 tempest-VolumesGetTest-361458807 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:42:34 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-d3687e69-3e22-4d72-8918-1e8dca74c754 tempest-VolumesGetTest-361458807 None] Deleted volume successfully. Nov 02 15:42:34 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d3687e69-3e22-4d72-8918-1e8dca74c754 tempest-VolumesGetTest-361458807 None] Lock "cinder-8aab9133-df96-42c6-b7c5-8fb9776d62bd-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:42:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-686451c1-5066-409e-acf5-4dcfaab99ab9 tempest-VolumesTransfersV357Test-1527692153 None] Acquiring lock "cinder-cd2ccd6a-516b-4ce6-b4d7-2911a7b80878-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:42:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-686451c1-5066-409e-acf5-4dcfaab99ab9 tempest-VolumesTransfersV357Test-1527692153 None] Lock "cinder-cd2ccd6a-516b-4ce6-b4d7-2911a7b80878-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:42:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-686451c1-5066-409e-acf5-4dcfaab99ab9 tempest-VolumesTransfersV357Test-1527692153 None] Acquiring lock "cinder-quobyte-cd2ccd6a-516b-4ce6-b4d7-2911a7b80878" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:42:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-686451c1-5066-409e-acf5-4dcfaab99ab9 tempest-VolumesTransfersV357Test-1527692153 None] Lock "cinder-quobyte-cd2ccd6a-516b-4ce6-b4d7-2911a7b80878" acquired by "delete_volume" :: waited 0.036s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:42:35 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[57de1759-835b-41fc-a742-1be4b932e298]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:42:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-686451c1-5066-409e-acf5-4dcfaab99ab9 tempest-VolumesTransfersV357Test-1527692153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-cd2ccd6a-516b-4ce6-b4d7-2911a7b80878 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:35 devstack sudo[101872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-cd2ccd6a-516b-4ce6-b4d7-2911a7b80878 Nov 02 15:42:35 devstack sudo[101872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-94237934-b5d0-48de-b21b-b95b5d48755a tempest-VolumesGetTest-361458807 None] Acquiring lock "cinder-08b39f21-5bf5-47ee-b8fd-ad54e2e36b4a-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:42:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-94237934-b5d0-48de-b21b-b95b5d48755a tempest-VolumesGetTest-361458807 None] Lock "cinder-08b39f21-5bf5-47ee-b8fd-ad54e2e36b4a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:42:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-94237934-b5d0-48de-b21b-b95b5d48755a tempest-VolumesGetTest-361458807 None] Acquiring lock "cinder-quobyte-08b39f21-5bf5-47ee-b8fd-ad54e2e36b4a" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:42:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-94237934-b5d0-48de-b21b-b95b5d48755a tempest-VolumesGetTest-361458807 None] Lock "cinder-quobyte-08b39f21-5bf5-47ee-b8fd-ad54e2e36b4a" acquired by "delete_volume" :: waited 0.025s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:42:35 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f39c87-93d7-4eb7-9367-9333b62ebc9d]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:42:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-94237934-b5d0-48de-b21b-b95b5d48755a tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-08b39f21-5bf5-47ee-b8fd-ad54e2e36b4a {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:35 devstack sudo[101872]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-686451c1-5066-409e-acf5-4dcfaab99ab9 tempest-VolumesTransfersV357Test-1527692153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-cd2ccd6a-516b-4ce6-b4d7-2911a7b80878" returned: 0 in 0.466s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-686451c1-5066-409e-acf5-4dcfaab99ab9 tempest-VolumesTransfersV357Test-1527692153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-cd2ccd6a-516b-4ce6-b4d7-2911a7b80878 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:35 devstack sudo[101879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-cd2ccd6a-516b-4ce6-b4d7-2911a7b80878 Nov 02 15:42:35 devstack sudo[101879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:35 devstack sudo[101876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-08b39f21-5bf5-47ee-b8fd-ad54e2e36b4a Nov 02 15:42:35 devstack sudo[101876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:35 devstack sudo[101879]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-686451c1-5066-409e-acf5-4dcfaab99ab9 tempest-VolumesTransfersV357Test-1527692153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-cd2ccd6a-516b-4ce6-b4d7-2911a7b80878" returned: 0 in 0.312s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-686451c1-5066-409e-acf5-4dcfaab99ab9 tempest-VolumesTransfersV357Test-1527692153 None] Lock "cinder-quobyte-cd2ccd6a-516b-4ce6-b4d7-2911a7b80878" released by "delete_volume" :: held 0.845s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:42:36 devstack sudo[101876]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-94237934-b5d0-48de-b21b-b95b5d48755a tempest-VolumesGetTest-361458807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-08b39f21-5bf5-47ee-b8fd-ad54e2e36b4a" returned: 0 in 0.480s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-94237934-b5d0-48de-b21b-b95b5d48755a tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-08b39f21-5bf5-47ee-b8fd-ad54e2e36b4a {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:36 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-686451c1-5066-409e-acf5-4dcfaab99ab9 tempest-VolumesTransfersV357Test-1527692153 None] Created reservations ['f29e1511-e7cf-49ee-84c1-c94fdb6c1494', '3e10a5a6-6436-413c-b1aa-ce34fe5737e6', '0fe32943-1a85-428a-85e9-9105bb6f1f29', 'b5334f32-5db3-421e-b35e-68823829d00b'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:42:36 devstack sudo[101887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-08b39f21-5bf5-47ee-b8fd-ad54e2e36b4a Nov 02 15:42:36 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-686451c1-5066-409e-acf5-4dcfaab99ab9 tempest-VolumesTransfersV357Test-1527692153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:42:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-686451c1-5066-409e-acf5-4dcfaab99ab9 tempest-VolumesTransfersV357Test-1527692153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:36 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-686451c1-5066-409e-acf5-4dcfaab99ab9 tempest-VolumesTransfersV357Test-1527692153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:42:36 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-686451c1-5066-409e-acf5-4dcfaab99ab9 tempest-VolumesTransfersV357Test-1527692153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:42:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-686451c1-5066-409e-acf5-4dcfaab99ab9 tempest-VolumesTransfersV357Test-1527692153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-686451c1-5066-409e-acf5-4dcfaab99ab9 tempest-VolumesTransfersV357Test-1527692153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:36 devstack sudo[101889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:42:36 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:36 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-94237934-b5d0-48de-b21b-b95b5d48755a tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-08b39f21-5bf5-47ee-b8fd-ad54e2e36b4a" returned: 0 in 0.376s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-94237934-b5d0-48de-b21b-b95b5d48755a tempest-VolumesGetTest-361458807 None] Lock "cinder-quobyte-08b39f21-5bf5-47ee-b8fd-ad54e2e36b4a" released by "delete_volume" :: held 0.929s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:42:36 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-94237934-b5d0-48de-b21b-b95b5d48755a tempest-VolumesGetTest-361458807 None] Created reservations ['3ab638fc-12bb-4154-aa74-ec18c69274b9', '0e4999f3-227b-4101-a8a4-08762027fd9b', '88017df8-549e-4aed-9e72-e0df910ff9d0', '9e51aef8-ab38-4659-85e0-adce55fd5c85'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:42:36 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-686451c1-5066-409e-acf5-4dcfaab99ab9 tempest-VolumesTransfersV357Test-1527692153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.453s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:36 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-686451c1-5066-409e-acf5-4dcfaab99ab9 tempest-VolumesTransfersV357Test-1527692153 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:42:36 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-686451c1-5066-409e-acf5-4dcfaab99ab9 tempest-VolumesTransfersV357Test-1527692153 None] Deleted volume successfully. Nov 02 15:42:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-686451c1-5066-409e-acf5-4dcfaab99ab9 tempest-VolumesTransfersV357Test-1527692153 None] Lock "cinder-cd2ccd6a-516b-4ce6-b4d7-2911a7b80878-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:42:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-94237934-b5d0-48de-b21b-b95b5d48755a tempest-VolumesGetTest-361458807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:42:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-94237934-b5d0-48de-b21b-b95b5d48755a tempest-VolumesGetTest-361458807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:36 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-94237934-b5d0-48de-b21b-b95b5d48755a tempest-VolumesGetTest-361458807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:42:36 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-94237934-b5d0-48de-b21b-b95b5d48755a tempest-VolumesGetTest-361458807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:42:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-94237934-b5d0-48de-b21b-b95b5d48755a tempest-VolumesGetTest-361458807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-94237934-b5d0-48de-b21b-b95b5d48755a tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:36 devstack sudo[101893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:42:36 devstack sudo[101893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:37 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:42:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] Flow 'volume_create_manager' (044ed084-7ef9-4b10-b3ea-562150dd1f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:42:37 devstack sudo[101893]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04dfb65a-2546-4854-aa65-33d28891ccec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-94237934-b5d0-48de-b21b-b95b5d48755a tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.403s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:37 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-94237934-b5d0-48de-b21b-b95b5d48755a tempest-VolumesGetTest-361458807 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:42:37 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-94237934-b5d0-48de-b21b-b95b5d48755a tempest-VolumesGetTest-361458807 None] Deleted volume successfully. Nov 02 15:42:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04dfb65a-2546-4854-aa65-33d28891ccec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1833929529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a91502-3878-4a1e-8753-682c6000d6b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af7fa2ee547c488a833a376eeea216e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:42:37Z,use_quota=True,user_id='ec577c6a0a6b4857809f51fdc933f71d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a1da39-b7e9-4f25-aeac-c26adff4feec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a1da39-b7e9-4f25-aeac-c26adff4feec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9e6c46-4e56-47fe-9fb7-377d662e9f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9e6c46-4e56-47fe-9fb7-377d662e9f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08a91502-3878-4a1e-8753-682c6000d6b3', 'volume_name': 'volume-08a91502-3878-4a1e-8753-682c6000d6b3', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86e2e4fd-0d6b-4d69-9670-ca97bf6f095e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86e2e4fd-0d6b-4d69-9670-ca97bf6f095e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cddf4f-1b95-4dbe-8da5-2993742730be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:37 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] Volume 08a91502-3878-4a1e-8753-682c6000d6b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08a91502-3878-4a1e-8753-682c6000d6b3', 'volume_size': 1} Nov 02 15:42:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:42:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1833929529',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08a91502-3878-4a1e-8753-682c6000d6b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af7fa2ee547c488a833a376eeea216e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:42:37Z,use_quota=True,user_id='ec577c6a0a6b4857809f51fdc933f71d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:42:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] Creating volume 08a91502-3878-4a1e-8753-682c6000d6b3 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:42:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:42:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:42:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:42:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:42:37 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:42:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-08a91502-3878-4a1e-8753-682c6000d6b3 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:37 devstack sudo[101896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-08a91502-3878-4a1e-8753-682c6000d6b3 1073741824 Nov 02 15:42:37 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-94237934-b5d0-48de-b21b-b95b5d48755a tempest-VolumesGetTest-361458807 None] Lock "cinder-08b39f21-5bf5-47ee-b8fd-ad54e2e36b4a-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:42:37 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:37 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-08a91502-3878-4a1e-8753-682c6000d6b3 1073741824" returned: 0 in 0.571s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-08a91502-3878-4a1e-8753-682c6000d6b3 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:37 devstack sudo[101903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-08a91502-3878-4a1e-8753-682c6000d6b3 Nov 02 15:42:37 devstack sudo[101903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:38 devstack sudo[101903]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-08a91502-3878-4a1e-8753-682c6000d6b3" returned: 0 in 0.345s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:42:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cddf4f-1b95-4dbe-8da5-2993742730be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08a91502-3878-4a1e-8753-682c6000d6b3', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ae293c2-0ca6-4cd4-8441-ab502f1dd3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:38 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] Volume volume-08a91502-3878-4a1e-8753-682c6000d6b3 (08a91502-3878-4a1e-8753-682c6000d6b3): created successfully Nov 02 15:42:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ae293c2-0ca6-4cd4-8441-ab502f1dd3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] Flow 'volume_create_manager' (044ed084-7ef9-4b10-b3ea-562150dd1f96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:42:38 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-fe0b3b1b-402f-4e75-92bb-34821f33870e tempest-VolumesTransfersV357Test-2127980712 None] Created volume successfully. Nov 02 15:42:38 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:42:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] Flow 'volume_create_manager' (77aebbc3-1622-4d5e-b4f1-ff56e2767a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:42:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (362a2cb2-a383-4724-8744-53d78b02c9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (362a2cb2-a383-4724-8744-53d78b02c9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1841581085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffdd794b-c897-424c-82c8-0a4fd3088065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8d704b8acea42669f54bf4850039cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:42:38Z,use_quota=True,user_id='f00e846dab1a4cfcb99f544db61cdcfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c1a9b9a-0300-46a0-b2f9-2e37a28dd834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c1a9b9a-0300-46a0-b2f9-2e37a28dd834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9379ba4-08a6-4bf8-b472-37b40779e263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9379ba4-08a6-4bf8-b472-37b40779e263) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffdd794b-c897-424c-82c8-0a4fd3088065', 'volume_name': 'volume-ffdd794b-c897-424c-82c8-0a4fd3088065', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f0c24d7-8af5-469f-9294-6d8f7480ad2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f0c24d7-8af5-469f-9294-6d8f7480ad2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3bda29b-0ee4-4858-a251-a3182fe47aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:38 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] Volume ffdd794b-c897-424c-82c8-0a4fd3088065: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffdd794b-c897-424c-82c8-0a4fd3088065', 'volume_size': 1} Nov 02 15:42:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:42:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1841581085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffdd794b-c897-424c-82c8-0a4fd3088065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8d704b8acea42669f54bf4850039cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:42:38Z,use_quota=True,user_id='f00e846dab1a4cfcb99f544db61cdcfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:42:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] Creating volume ffdd794b-c897-424c-82c8-0a4fd3088065 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:42:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:42:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:42:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:42:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:42:38 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:42:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:38 devstack sudo[101907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065 1073741824 Nov 02 15:42:38 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:38 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065 1073741824" returned: 0 in 0.505s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:39 devstack sudo[101913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065 Nov 02 15:42:39 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:39 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065" returned: 0 in 0.354s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:39 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:42:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:39 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3bda29b-0ee4-4858-a251-a3182fe47aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffdd794b-c897-424c-82c8-0a4fd3088065', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:39 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8ef62c0-471e-4ca8-8a54-1ff7a8476a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:39 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] Volume volume-ffdd794b-c897-424c-82c8-0a4fd3088065 (ffdd794b-c897-424c-82c8-0a4fd3088065): created successfully Nov 02 15:42:39 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8ef62c0-471e-4ca8-8a54-1ff7a8476a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:39 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] Flow 'volume_create_manager' (77aebbc3-1622-4d5e-b4f1-ff56e2767a1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:42:39 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-0a8381af-be34-45e7-a4be-33cdd1932a53 tempest-VolumesGetTest-361458807 None] Created volume successfully. Nov 02 15:42:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6860adbb-fb18-4f43-99d8-77af2bc6d33b tempest-VolumesTransfersV357Test-1527692153 None] Acquiring lock "cinder-08a91502-3878-4a1e-8753-682c6000d6b3-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:42:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6860adbb-fb18-4f43-99d8-77af2bc6d33b tempest-VolumesTransfersV357Test-1527692153 None] Lock "cinder-08a91502-3878-4a1e-8753-682c6000d6b3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:42:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6860adbb-fb18-4f43-99d8-77af2bc6d33b tempest-VolumesTransfersV357Test-1527692153 None] Acquiring lock "cinder-quobyte-08a91502-3878-4a1e-8753-682c6000d6b3" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:42:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6860adbb-fb18-4f43-99d8-77af2bc6d33b tempest-VolumesTransfersV357Test-1527692153 None] Lock "cinder-quobyte-08a91502-3878-4a1e-8753-682c6000d6b3" acquired by "delete_volume" :: waited 0.022s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:42:39 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[957f2b71-bf4b-40ac-bbcb-0dbc04349d0b]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:42:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6860adbb-fb18-4f43-99d8-77af2bc6d33b tempest-VolumesTransfersV357Test-1527692153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-08a91502-3878-4a1e-8753-682c6000d6b3 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:39 devstack sudo[101916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-08a91502-3878-4a1e-8753-682c6000d6b3 Nov 02 15:42:39 devstack sudo[101916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:40 devstack sudo[101916]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6860adbb-fb18-4f43-99d8-77af2bc6d33b tempest-VolumesTransfersV357Test-1527692153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-08a91502-3878-4a1e-8753-682c6000d6b3" returned: 0 in 0.439s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6860adbb-fb18-4f43-99d8-77af2bc6d33b tempest-VolumesTransfersV357Test-1527692153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-08a91502-3878-4a1e-8753-682c6000d6b3 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:40 devstack sudo[101922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-08a91502-3878-4a1e-8753-682c6000d6b3 Nov 02 15:42:40 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:40 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6860adbb-fb18-4f43-99d8-77af2bc6d33b tempest-VolumesTransfersV357Test-1527692153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-08a91502-3878-4a1e-8753-682c6000d6b3" returned: 0 in 0.277s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6860adbb-fb18-4f43-99d8-77af2bc6d33b tempest-VolumesTransfersV357Test-1527692153 None] Lock "cinder-quobyte-08a91502-3878-4a1e-8753-682c6000d6b3" released by "delete_volume" :: held 0.779s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:42:40 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-6860adbb-fb18-4f43-99d8-77af2bc6d33b tempest-VolumesTransfersV357Test-1527692153 None] Created reservations ['6db87808-58ca-407f-985b-16b4acd2f901', '5d677b8d-e80b-44b6-accf-fed63d879cbd', '0419a7cb-d11d-4ca0-9aa1-6c3d513f2bb0', 'ac34d1e4-703d-4271-bff7-0d2abb8dc101'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:42:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-6860adbb-fb18-4f43-99d8-77af2bc6d33b tempest-VolumesTransfersV357Test-1527692153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:42:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-6860adbb-fb18-4f43-99d8-77af2bc6d33b tempest-VolumesTransfersV357Test-1527692153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:40 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-6860adbb-fb18-4f43-99d8-77af2bc6d33b tempest-VolumesTransfersV357Test-1527692153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:42:40 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-6860adbb-fb18-4f43-99d8-77af2bc6d33b tempest-VolumesTransfersV357Test-1527692153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:42:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-6860adbb-fb18-4f43-99d8-77af2bc6d33b tempest-VolumesTransfersV357Test-1527692153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6860adbb-fb18-4f43-99d8-77af2bc6d33b tempest-VolumesTransfersV357Test-1527692153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:40 devstack sudo[101925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:42:40 devstack sudo[101925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:40 devstack sudo[101925]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6860adbb-fb18-4f43-99d8-77af2bc6d33b tempest-VolumesTransfersV357Test-1527692153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.380s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:40 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-6860adbb-fb18-4f43-99d8-77af2bc6d33b tempest-VolumesTransfersV357Test-1527692153 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:42:40 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-6860adbb-fb18-4f43-99d8-77af2bc6d33b tempest-VolumesTransfersV357Test-1527692153 None] Deleted volume successfully. Nov 02 15:42:41 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6860adbb-fb18-4f43-99d8-77af2bc6d33b tempest-VolumesTransfersV357Test-1527692153 None] Lock "cinder-08a91502-3878-4a1e-8753-682c6000d6b3-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:42:41 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:42:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Flow 'volume_create_manager' (19a6cb41-ef8b-45d3-86f2-bc65e5162fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:42:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8adb2f67-ccf5-49bf-bb25-294fbcdbb881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8adb2f67-ccf5-49bf-bb25-294fbcdbb881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-490617559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b43e6145-f012-4c7f-abc8-cef8405e3e28,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e8d704b8acea42669f54bf4850039cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:42:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=ffdd794b-c897-424c-82c8-0a4fd3088065,status='creating',terminated_at=None,updated_at=2026-11-02T14:42:41Z,use_quota=True,user_id='f00e846dab1a4cfcb99f544db61cdcfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (397c049a-6f41-4c8b-831d-49bc6b70f7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (397c049a-6f41-4c8b-831d-49bc6b70f7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56db2c76-41ad-454e-b67a-6c7ef44c6a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56db2c76-41ad-454e-b67a-6c7ef44c6a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b43e6145-f012-4c7f-abc8-cef8405e3e28', 'volume_name': 'volume-b43e6145-f012-4c7f-abc8-cef8405e3e28', 'volume_size': 1, 'source_volid': 'ffdd794b-c897-424c-82c8-0a4fd3088065', 'source_volstatus': 'available'}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfab20b8-107b-4d57-a4fd-bcb0ee397fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfab20b8-107b-4d57-a4fd-bcb0ee397fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e24cb4-95f8-45eb-ac5d-0b6ab3dbe6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:41 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Volume b43e6145-f012-4c7f-abc8-cef8405e3e28: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b43e6145-f012-4c7f-abc8-cef8405e3e28', 'volume_size': 1, 'source_volid': 'ffdd794b-c897-424c-82c8-0a4fd3088065', 'source_volstatus': 'available'} Nov 02 15:42:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:42:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:41 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Cloning volume ffdd794b-c897-424c-82c8-0a4fd3088065 to volume b43e6145-f012-4c7f-abc8-cef8405e3e28 Nov 02 15:42:41 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Creating offline snapshot 2bc95eb1-96bf-4689-a717-70446a1446c0 of volume ffdd794b-c897-424c-82c8-0a4fd3088065 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:42:41 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d382c337-830a-4b27-ac9a-fbd2afc28fd4]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:42:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:41 devstack sudo[101928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065 Nov 02 15:42:41 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:41 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065" returned: 0 in 0.468s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065.2bc95eb1-96bf-4689-a717-70446a1446c0 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:41 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065.2bc95eb1-96bf-4689-a717-70446a1446c0 1G Nov 02 15:42:41 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:42 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065.2bc95eb1-96bf-4689-a717-70446a1446c0 1G" returned: 0 in 0.541s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffdd794b-c897-424c-82c8-0a4fd3088065 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065.2bc95eb1-96bf-4689-a717-70446a1446c0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:42 devstack sudo[101939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffdd794b-c897-424c-82c8-0a4fd3088065 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065.2bc95eb1-96bf-4689-a717-70446a1446c0 Nov 02 15:42:42 devstack sudo[101939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:42 devstack sudo[101939]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffdd794b-c897-424c-82c8-0a4fd3088065 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065.2bc95eb1-96bf-4689-a717-70446a1446c0" returned: 0 in 0.450s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:42 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065.2bc95eb1-96bf-4689-a717-70446a1446c0 is being set with open permissions: ugo+rw Nov 02 15:42:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065.2bc95eb1-96bf-4689-a717-70446a1446c0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:42 devstack sudo[101944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065.2bc95eb1-96bf-4689-a717-70446a1446c0 Nov 02 15:42:42 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:43 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065.2bc95eb1-96bf-4689-a717-70446a1446c0" returned: 0 in 0.268s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:43 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065.info Nov 02 15:42:43 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:43 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065.info" returned: 0 in 0.286s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:43 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065.info is being set with open permissions: ugo+rw Nov 02 15:42:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:43 devstack sudo[101951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065.info Nov 02 15:42:43 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:43 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065.info" returned: 0 in 0.277s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:43 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Acquiring lock "cinder-quobyte-b43e6145-f012-4c7f-abc8-cef8405e3e28" by "_copy_volume_from_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:42:43 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Lock "cinder-quobyte-b43e6145-f012-4c7f-abc8-cef8405e3e28" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:42:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] snapshot: 2bc95eb1-96bf-4689-a717-70446a1446c0, volume: b43e6145-f012-4c7f-abc8-cef8405e3e28, {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 15:42:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:42:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:42:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:42:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:43 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ccd74c-979c-4b8a-abfc-9bad0d65b55d]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:42:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065.2bc95eb1-96bf-4689-a717-70446a1446c0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:44 devstack sudo[101954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065.2bc95eb1-96bf-4689-a717-70446a1446c0 Nov 02 15:42:44 devstack sudo[101954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:44 devstack sudo[101954]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065.2bc95eb1-96bf-4689-a717-70446a1446c0" returned: 0 in 0.574s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:44 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffdd794b-c897-424c-82c8-0a4fd3088065(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:42:44 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd43abc-2138-48e7-9c24-da2fbd3de54b]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:42:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:44 devstack sudo[101960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065 Nov 02 15:42:44 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:44 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065" returned: 0 in 0.459s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:44 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] will copy from snapshot at /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065 {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 15:42:44 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Creating direct copy from snapshot {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 15:42:44 devstack cinder-volume[86703]: DEBUG cinder.utils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Path /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b43e6145-f012-4c7f-abc8-cef8405e3e28 not found in is_blk_device check {{(pid=86703) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 15:42:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b43e6145-f012-4c7f-abc8-cef8405e3e28 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:44 devstack sudo[101965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b43e6145-f012-4c7f-abc8-cef8405e3e28 Nov 02 15:42:44 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:53 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:UPDATE=120,cinder:SELECT=93,cinder:DELETE=10,cinder:INSERT=30 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:42:53 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=95,cinder:UPDATE=120,cinder:INSERT=27,cinder:DELETE=11 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:42:53 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b43e6145-f012-4c7f-abc8-cef8405e3e28" returned: 0 in 9.015s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:53 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Image conversion details: src /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065, size 1024.00 MB, duration 9.02 sec, destination /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b43e6145-f012-4c7f-abc8-cef8405e3e28 {{(pid=86703) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 15:42:53 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Converted 1024.00 MB image at 113.58 MB/s Nov 02 15:42:53 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b43e6145-f012-4c7f-abc8-cef8405e3e28 is being set with open permissions: ugo+rw Nov 02 15:42:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b43e6145-f012-4c7f-abc8-cef8405e3e28 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:54 devstack sudo[101981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b43e6145-f012-4c7f-abc8-cef8405e3e28 Nov 02 15:42:54 devstack sudo[101981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:54 devstack sudo[101981]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b43e6145-f012-4c7f-abc8-cef8405e3e28" returned: 0 in 0.365s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:54 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Lock "cinder-quobyte-b43e6145-f012-4c7f-abc8-cef8405e3e28" released by "_copy_volume_from_snapshot" :: held 10.527s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:42:54 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Acquiring lock "cinder-quobyte-2bc95eb1-96bf-4689-a717-70446a1446c0" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:42:54 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Lock "cinder-quobyte-2bc95eb1-96bf-4689-a717-70446a1446c0" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:42:54 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Deleting offline snapshot 2bc95eb1-96bf-4689-a717-70446a1446c0 of volume ffdd794b-c897-424c-82c8-0a4fd3088065 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:42:54 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] snapshot_file for this snap is: volume-ffdd794b-c897-424c-82c8-0a4fd3088065.2bc95eb1-96bf-4689-a717-70446a1446c0 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:42:54 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa773c47-cf29-4611-b3c3-a93e6582b86d]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:42:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065.2bc95eb1-96bf-4689-a717-70446a1446c0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:54 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065.2bc95eb1-96bf-4689-a717-70446a1446c0 Nov 02 15:42:54 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:54 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:42:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Flow 'volume_create_manager' (c4eb6c33-6087-4e84-b7da-79ba6bbe52f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:42:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef30c227-8ebc-4831-b502-6e3d3c728916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef30c227-8ebc-4831-b502-6e3d3c728916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1730355394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf4dbb2f-1865-436d-a403-e44b1f730e82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7299c6c02e604d34bd5facac7ab37ede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:42:55Z,use_quota=True,user_id='12b2ba9639484217b0e6d1fe497b5173',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f01fa25-3785-4b7a-93b4-754799d065e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f01fa25-3785-4b7a-93b4-754799d065e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbca005a-4c7d-4fe7-be21-d5bec7453919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:54 devstack cinder-volume[86703]: DEBUG cinder.image.glance [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Creating Keystone auth plugin from conf {{(pid=86703) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 15:42:54 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065.2bc95eb1-96bf-4689-a717-70446a1446c0" returned: 0 in 0.538s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:54 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffdd794b-c897-424c-82c8-0a4fd3088065(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:42:55 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7769db43-b652-436d-ad00-b9df4c345b01]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:42:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:55 devstack sudo[101991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065 Nov 02 15:42:55 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:55 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbca005a-4c7d-4fe7-be21-d5bec7453919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bf4dbb2f-1865-436d-a403-e44b1f730e82', 'volume_name': 'volume-bf4dbb2f-1865-436d-a403-e44b1f730e82', 'volume_size': 1, 'image_id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '583ef2b19215459298db002053800c52', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'created_at': datetime.datetime(2026, 11, 2, 14, 23, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 14, 23, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:55 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec79648f-c149-47a1-abab-62d5f01216f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:55 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec79648f-c149-47a1-abab-62d5f01216f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:55 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (836e6382-2998-4c1c-8f78-81ebcc93ed96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:55 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Volume bf4dbb2f-1865-436d-a403-e44b1f730e82: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bf4dbb2f-1865-436d-a403-e44b1f730e82', 'volume_size': 1, 'image_id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '583ef2b19215459298db002053800c52', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'created_at': datetime.datetime(2026, 11, 2, 14, 23, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 14, 23, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 15:42:55 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Trying to clone bf4dbb2f-1865-436d-a403-e44b1f730e82 from image 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 at location (None, [{'url': 'file:///opt/stack/data/glance/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'metadata': {}}]). {{(pid=86703) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 15:42:55 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_3hpgfsdedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86703) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 15:42:55 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Image download 20.69 MB at 20.69 MB/s Nov 02 15:42:55 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d56b32-fe52-47b9-972b-2ea1ec173295]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:42:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_3hpgfsdedevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:55 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:55 devstack sudo[102031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_3hpgfsdedevstack@QuobyteHD Nov 02 15:42:55 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065" returned: 0 in 0.908s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065.2bc95eb1-96bf-4689-a717-70446a1446c0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:56 devstack sudo[102034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065.2bc95eb1-96bf-4689-a717-70446a1446c0 Nov 02 15:42:56 devstack sudo[102034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:56 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_3hpgfsdedevstack@QuobyteHD" returned: 0 in 0.433s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:56 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Temporary image 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 is fetched for user 12b2ba9639484217b0e6d1fe497b5173. {{(pid=86703) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 15:42:56 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d0d6b5-2ce0-4167-a687-909deb078cd9]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:42:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_3hpgfsdedevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:56 devstack sudo[102044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_3hpgfsdedevstack@QuobyteHD Nov 02 15:42:56 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:56 devstack sudo[102034]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065.2bc95eb1-96bf-4689-a717-70446a1446c0" returned: 0 in 0.640s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065.2bc95eb1-96bf-4689-a717-70446a1446c0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:56 devstack sudo[102047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065.2bc95eb1-96bf-4689-a717-70446a1446c0 Nov 02 15:42:56 devstack sudo[102047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:56 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_3hpgfsdedevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:42:56 devstack sudo[102047]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065.2bc95eb1-96bf-4689-a717-70446a1446c0" returned: 0 in 0.308s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:56 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Lock "cinder-quobyte-2bc95eb1-96bf-4689-a717-70446a1446c0" released by "_delete_snapshot" :: held 2.544s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:42:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.636s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.230s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1730355394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf4dbb2f-1865-436d-a403-e44b1f730e82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7299c6c02e604d34bd5facac7ab37ede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:42:55Z,use_quota=True,user_id='12b2ba9639484217b0e6d1fe497b5173',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:42:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Creating volume bf4dbb2f-1865-436d-a403-e44b1f730e82 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:42:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:42:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:42:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:42:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:42:57 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:42:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf4dbb2f-1865-436d-a403-e44b1f730e82 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e24cb4-95f8-45eb-ac5d-0b6ab3dbe6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b43e6145-f012-4c7f-abc8-cef8405e3e28', 'volume_size': 1, 'source_volid': 'ffdd794b-c897-424c-82c8-0a4fd3088065', 'source_volstatus': 'available'}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:57 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf4dbb2f-1865-436d-a403-e44b1f730e82 1073741824 Nov 02 15:42:57 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e898f28a-d306-4417-a488-a7715e8ea848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:57 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Volume volume-b43e6145-f012-4c7f-abc8-cef8405e3e28 (b43e6145-f012-4c7f-abc8-cef8405e3e28): created successfully Nov 02 15:42:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e898f28a-d306-4417-a488-a7715e8ea848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Flow 'volume_create_manager' (19a6cb41-ef8b-45d3-86f2-bc65e5162fb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:42:57 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-327ad653-6f1b-4b72-b2c0-b7d5809e25f4 tempest-VolumesGetTest-361458807 None] Created volume successfully. Nov 02 15:42:57 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf4dbb2f-1865-436d-a403-e44b1f730e82 1073741824" returned: 0 in 0.480s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf4dbb2f-1865-436d-a403-e44b1f730e82 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:57 devstack sudo[102062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf4dbb2f-1865-436d-a403-e44b1f730e82 Nov 02 15:42:57 devstack sudo[102062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:57 devstack sudo[102062]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf4dbb2f-1865-436d-a403-e44b1f730e82" returned: 0 in 0.297s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:42:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:57 devstack cinder-volume[86703]: DEBUG cinder.volume.volume_utils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Attempting download of 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 ((None, [{'url': 'file:///opt/stack/data/glance/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'metadata': {}}])) to volume bf4dbb2f-1865-436d-a403-e44b1f730e82. {{(pid=86703) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 15:42:57 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe99856-cc8b-49ba-b054-528c86e0065a]: (4, 'raw') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:42:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_noe_f_fq {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:58 devstack sudo[102065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_noe_f_fq Nov 02 15:42:58 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:58 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_noe_f_fq" returned: 0 in 0.370s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_noe_f_fq {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:58 devstack sudo[102069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_noe_f_fq Nov 02 15:42:58 devstack sudo[102069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:58 devstack sudo[102069]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_noe_f_fq" returned: 1 in 0.381s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_noe_f_fq' failed. Not Retrying. {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 15:42:58 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f57d11d-9ef6-4f61-b60b-d95912babb9b]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:42:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_3hpgfsdedevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:58 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_3hpgfsdedevstack@QuobyteHD Nov 02 15:42:58 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:58 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:42:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] Flow 'volume_create_manager' (f0ce729f-48dd-4bab-bd46-3742b93d6bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:42:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd0384bc-30e9-4b23-a7e8-e5d936d98d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:59 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd0384bc-30e9-4b23-a7e8-e5d936d98d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:42:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1836378219',display_name='tempest-VolumesGetTest-Volume-1180423568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2114b00a-e188-495b-861b-881bde00679a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8d704b8acea42669f54bf4850039cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:42:59Z,use_quota=True,user_id='f00e846dab1a4cfcb99f544db61cdcfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:59 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed004589-7369-4dc4-91ab-63f33d4d8ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:59 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed004589-7369-4dc4-91ab-63f33d4d8ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:59 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c76f99c-7f3f-46b8-9aa8-16a7e46d0b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:59 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c76f99c-7f3f-46b8-9aa8-16a7e46d0b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2114b00a-e188-495b-861b-881bde00679a', 'volume_name': 'volume-2114b00a-e188-495b-861b-881bde00679a', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:59 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b03281-3cb3-4eaf-8cff-337fc53b8ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:59 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b03281-3cb3-4eaf-8cff-337fc53b8ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:59 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:59 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25b9b49f-c5a5-4364-8a2c-3cdbcc54ed24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:59 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] Volume 2114b00a-e188-495b-861b-881bde00679a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2114b00a-e188-495b-861b-881bde00679a', 'volume_size': 1} Nov 02 15:42:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:42:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:42:59Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1836378219',display_name='tempest-VolumesGetTest-Volume-1180423568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2114b00a-e188-495b-861b-881bde00679a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8d704b8acea42669f54bf4850039cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:42:59Z,use_quota=True,user_id='f00e846dab1a4cfcb99f544db61cdcfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:42:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] Creating volume 2114b00a-e188-495b-861b-881bde00679a {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:42:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:42:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:42:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:42:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:42:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:42:59 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:42:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2114b00a-e188-495b-861b-881bde00679a 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_3hpgfsdedevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:59 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 was qcow2, converting to qcow2 {{(pid=86703) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 15:42:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_3hpgfsdedevstack@QuobyteHD /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf4dbb2f-1865-436d-a403-e44b1f730e82 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:59 devstack sudo[102078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2114b00a-e188-495b-861b-881bde00679a 1073741824 Nov 02 15:42:59 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:59 devstack sudo[102079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_3hpgfsdedevstack@QuobyteHD /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf4dbb2f-1865-436d-a403-e44b1f730e82 Nov 02 15:42:59 devstack sudo[102079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:59 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2114b00a-e188-495b-861b-881bde00679a 1073741824" returned: 0 in 0.459s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2114b00a-e188-495b-861b-881bde00679a {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:42:59 devstack sudo[102093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2114b00a-e188-495b-861b-881bde00679a Nov 02 15:42:59 devstack sudo[102093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:42:59 devstack sudo[102093]: pam_unix(sudo:session): session closed for user root Nov 02 15:42:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2114b00a-e188-495b-861b-881bde00679a" returned: 0 in 0.301s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:42:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:42:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:42:59 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25b9b49f-c5a5-4364-8a2c-3cdbcc54ed24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2114b00a-e188-495b-861b-881bde00679a', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:59 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a01560f0-3de8-4d27-aaa0-11279b2b8edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:42:59 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] Volume volume-2114b00a-e188-495b-861b-881bde00679a (2114b00a-e188-495b-861b-881bde00679a): created successfully Nov 02 15:42:59 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a01560f0-3de8-4d27-aaa0-11279b2b8edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:42:59 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] Flow 'volume_create_manager' (f0ce729f-48dd-4bab-bd46-3742b93d6bc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:42:59 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-02222950-aa64-432f-bed4-26f9cbd93773 tempest-VolumesGetTest-361458807 None] Created volume successfully. Nov 02 15:43:01 devstack sudo[102079]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_3hpgfsdedevstack@QuobyteHD /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf4dbb2f-1865-436d-a403-e44b1f730e82" returned: 0 in 2.107s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:01 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_3hpgfsdedevstack@QuobyteHD, size 112.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf4dbb2f-1865-436d-a403-e44b1f730e82 {{(pid=86703) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 15:43:01 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Converted 112.00 MB image at 53.13 MB/s Nov 02 15:43:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf4dbb2f-1865-436d-a403-e44b1f730e82 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:01 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-646a0e00-fcee-4a58-be40-12b733a8eff5 tempest-VolumesGetTest-361458807 None] Acquiring lock "cinder-2114b00a-e188-495b-861b-881bde00679a-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:01 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf4dbb2f-1865-436d-a403-e44b1f730e82 1G Nov 02 15:43:01 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:01 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-646a0e00-fcee-4a58-be40-12b733a8eff5 tempest-VolumesGetTest-361458807 None] Lock "cinder-2114b00a-e188-495b-861b-881bde00679a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:01 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-646a0e00-fcee-4a58-be40-12b733a8eff5 tempest-VolumesGetTest-361458807 None] Acquiring lock "cinder-quobyte-2114b00a-e188-495b-861b-881bde00679a" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:01 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-646a0e00-fcee-4a58-be40-12b733a8eff5 tempest-VolumesGetTest-361458807 None] Lock "cinder-quobyte-2114b00a-e188-495b-861b-881bde00679a" acquired by "delete_volume" :: waited 0.017s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:01 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e42810-1c96-4d2e-a824-34fdd31a1154]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:43:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-646a0e00-fcee-4a58-be40-12b733a8eff5 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2114b00a-e188-495b-861b-881bde00679a {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:01 devstack sudo[102098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2114b00a-e188-495b-861b-881bde00679a Nov 02 15:43:01 devstack sudo[102098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:01 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf4dbb2f-1865-436d-a403-e44b1f730e82 1G" returned: 0 in 0.373s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:01 devstack cinder-volume[86703]: DEBUG cinder.volume.volume_utils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Downloaded image 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 ((None, [{'url': 'file:///opt/stack/data/glance/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'metadata': {}}])) to volume bf4dbb2f-1865-436d-a403-e44b1f730e82 successfully. {{(pid=86703) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 15:43:01 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Temporary image 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 for user 12b2ba9639484217b0e6d1fe497b5173 is deleted. {{(pid=86703) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 15:43:01 devstack cinder-volume[86703]: DEBUG cinder.volume.volume_utils [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Marking volume bf4dbb2f-1865-436d-a403-e44b1f730e82 as bootable. {{(pid=86703) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 15:43:01 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Copying metadata from image 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 to bf4dbb2f-1865-436d-a403-e44b1f730e82. {{(pid=86703) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 15:43:01 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Creating volume glance metadata for volume bf4dbb2f-1865-436d-a403-e44b1f730e82 backed by image 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86703) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 15:43:01 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (836e6382-2998-4c1c-8f78-81ebcc93ed96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf4dbb2f-1865-436d-a403-e44b1f730e82', 'volume_size': 1, 'image_id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '583ef2b19215459298db002053800c52', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'created_at': datetime.datetime(2026, 11, 2, 14, 23, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 14, 23, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:01 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c83e6977-d4cc-4e0d-9d23-954ed2130fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:01 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Volume volume-bf4dbb2f-1865-436d-a403-e44b1f730e82 (bf4dbb2f-1865-436d-a403-e44b1f730e82): created successfully Nov 02 15:43:01 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c83e6977-d4cc-4e0d-9d23-954ed2130fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:01 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Flow 'volume_create_manager' (c4eb6c33-6087-4e84-b7da-79ba6bbe52f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:43:01 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-67b86cf8-8541-4ba9-88e6-bdf81fa92f83 tempest-VolumesExtendTest-1940863257 None] Created volume successfully. Nov 02 15:43:01 devstack sudo[102098]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-646a0e00-fcee-4a58-be40-12b733a8eff5 tempest-VolumesGetTest-361458807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2114b00a-e188-495b-861b-881bde00679a" returned: 0 in 0.428s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-646a0e00-fcee-4a58-be40-12b733a8eff5 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2114b00a-e188-495b-861b-881bde00679a {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:01 devstack sudo[102106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2114b00a-e188-495b-861b-881bde00679a Nov 02 15:43:01 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:02 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-646a0e00-fcee-4a58-be40-12b733a8eff5 tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2114b00a-e188-495b-861b-881bde00679a" returned: 0 in 0.251s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:02 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-646a0e00-fcee-4a58-be40-12b733a8eff5 tempest-VolumesGetTest-361458807 None] Lock "cinder-quobyte-2114b00a-e188-495b-861b-881bde00679a" released by "delete_volume" :: held 0.737s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:43:02 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-646a0e00-fcee-4a58-be40-12b733a8eff5 tempest-VolumesGetTest-361458807 None] Created reservations ['17fc4f2f-c15c-4ea3-a48f-d9c2bf633574', 'e7c319e6-2a6d-4c95-acd2-3cf028c17ec4', 'fa40371e-c1f2-4316-943e-dc13156036ec', 'a47f2ae0-9bd5-4eed-9e7a-a8542d4c25fe'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:43:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-646a0e00-fcee-4a58-be40-12b733a8eff5 tempest-VolumesGetTest-361458807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-646a0e00-fcee-4a58-be40-12b733a8eff5 tempest-VolumesGetTest-361458807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-646a0e00-fcee-4a58-be40-12b733a8eff5 tempest-VolumesGetTest-361458807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:43:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-646a0e00-fcee-4a58-be40-12b733a8eff5 tempest-VolumesGetTest-361458807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:43:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-646a0e00-fcee-4a58-be40-12b733a8eff5 tempest-VolumesGetTest-361458807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-646a0e00-fcee-4a58-be40-12b733a8eff5 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:02 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:43:02 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:02 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-646a0e00-fcee-4a58-be40-12b733a8eff5 tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.270s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:02 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-646a0e00-fcee-4a58-be40-12b733a8eff5 tempest-VolumesGetTest-361458807 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:43:02 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-646a0e00-fcee-4a58-be40-12b733a8eff5 tempest-VolumesGetTest-361458807 None] Deleted volume successfully. Nov 02 15:43:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0082e008-0412-4821-8159-3ef0fef56847 tempest-VolumesExtendTest-1940863257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0082e008-0412-4821-8159-3ef0fef56847 tempest-VolumesExtendTest-1940863257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:02 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-646a0e00-fcee-4a58-be40-12b733a8eff5 tempest-VolumesGetTest-361458807 None] Lock "cinder-2114b00a-e188-495b-861b-881bde00679a-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:43:02 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ac1a6af0-0f94-4525-9f1a-a5199d2bb49f tempest-VolumesGetTest-361458807 None] Acquiring lock "cinder-b43e6145-f012-4c7f-abc8-cef8405e3e28-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:02 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2f7f74-cb0f-4dae-859c-0b8fdaaade5e]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:43:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0082e008-0412-4821-8159-3ef0fef56847 tempest-VolumesExtendTest-1940863257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf4dbb2f-1865-436d-a403-e44b1f730e82 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:02 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ac1a6af0-0f94-4525-9f1a-a5199d2bb49f tempest-VolumesGetTest-361458807 None] Lock "cinder-b43e6145-f012-4c7f-abc8-cef8405e3e28-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:02 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ac1a6af0-0f94-4525-9f1a-a5199d2bb49f tempest-VolumesGetTest-361458807 None] Acquiring lock "cinder-quobyte-b43e6145-f012-4c7f-abc8-cef8405e3e28" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:02 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ac1a6af0-0f94-4525-9f1a-a5199d2bb49f tempest-VolumesGetTest-361458807 None] Lock "cinder-quobyte-b43e6145-f012-4c7f-abc8-cef8405e3e28" acquired by "delete_volume" :: waited 0.017s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:02 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96f46c2-5c36-44cc-b170-beaca110cef2]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:43:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ac1a6af0-0f94-4525-9f1a-a5199d2bb49f tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b43e6145-f012-4c7f-abc8-cef8405e3e28 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:02 devstack sudo[102112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf4dbb2f-1865-436d-a403-e44b1f730e82 Nov 02 15:43:02 devstack sudo[102112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:02 devstack sudo[102113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b43e6145-f012-4c7f-abc8-cef8405e3e28 Nov 02 15:43:02 devstack sudo[102113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:02 devstack sudo[102112]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0082e008-0412-4821-8159-3ef0fef56847 tempest-VolumesExtendTest-1940863257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf4dbb2f-1865-436d-a403-e44b1f730e82" returned: 0 in 0.389s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0082e008-0412-4821-8159-3ef0fef56847 tempest-VolumesExtendTest-1940863257 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf4dbb2f-1865-436d-a403-e44b1f730e82 2G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:03 devstack sudo[102113]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ac1a6af0-0f94-4525-9f1a-a5199d2bb49f tempest-VolumesGetTest-361458807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b43e6145-f012-4c7f-abc8-cef8405e3e28" returned: 0 in 0.377s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ac1a6af0-0f94-4525-9f1a-a5199d2bb49f tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b43e6145-f012-4c7f-abc8-cef8405e3e28 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0082e008-0412-4821-8159-3ef0fef56847 tempest-VolumesExtendTest-1940863257 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf4dbb2f-1865-436d-a403-e44b1f730e82 2G" returned: 0 in 0.112s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0082e008-0412-4821-8159-3ef0fef56847 tempest-VolumesExtendTest-1940863257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.543s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:03 devstack sudo[102128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b43e6145-f012-4c7f-abc8-cef8405e3e28 Nov 02 15:43:03 devstack sudo[102128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:03 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-0082e008-0412-4821-8159-3ef0fef56847 tempest-VolumesExtendTest-1940863257 None] Extend volume completed successfully. Nov 02 15:43:03 devstack sudo[102128]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ac1a6af0-0f94-4525-9f1a-a5199d2bb49f tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b43e6145-f012-4c7f-abc8-cef8405e3e28" returned: 0 in 0.278s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ac1a6af0-0f94-4525-9f1a-a5199d2bb49f tempest-VolumesGetTest-361458807 None] Lock "cinder-quobyte-b43e6145-f012-4c7f-abc8-cef8405e3e28" released by "delete_volume" :: held 0.705s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:43:03 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-ac1a6af0-0f94-4525-9f1a-a5199d2bb49f tempest-VolumesGetTest-361458807 None] Created reservations ['8c96be0b-e3a6-4d02-8319-c4379db8b5db', 'ab0d3e7e-bce9-4109-a8be-bc372aec3360', '34237718-3ee7-4604-b638-0f41b317b4a4', '588d09bf-52d1-40c5-9162-a8144f902961'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:43:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ac1a6af0-0f94-4525-9f1a-a5199d2bb49f tempest-VolumesGetTest-361458807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ac1a6af0-0f94-4525-9f1a-a5199d2bb49f tempest-VolumesGetTest-361458807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:03 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ac1a6af0-0f94-4525-9f1a-a5199d2bb49f tempest-VolumesGetTest-361458807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:43:03 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ac1a6af0-0f94-4525-9f1a-a5199d2bb49f tempest-VolumesGetTest-361458807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:43:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ac1a6af0-0f94-4525-9f1a-a5199d2bb49f tempest-VolumesGetTest-361458807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ac1a6af0-0f94-4525-9f1a-a5199d2bb49f tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:03 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:43:03 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5e78eda8-8c1e-44be-924a-19dd5af9858a tempest-VolumesGetTest-361458807 None] Acquiring lock "cinder-ffdd794b-c897-424c-82c8-0a4fd3088065-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5e78eda8-8c1e-44be-924a-19dd5af9858a tempest-VolumesGetTest-361458807 None] Lock "cinder-ffdd794b-c897-424c-82c8-0a4fd3088065-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:04 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ac1a6af0-0f94-4525-9f1a-a5199d2bb49f tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.397s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:04 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-ac1a6af0-0f94-4525-9f1a-a5199d2bb49f tempest-VolumesGetTest-361458807 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:43:04 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-ac1a6af0-0f94-4525-9f1a-a5199d2bb49f tempest-VolumesGetTest-361458807 None] Deleted volume successfully. Nov 02 15:43:04 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ac1a6af0-0f94-4525-9f1a-a5199d2bb49f tempest-VolumesGetTest-361458807 None] Lock "cinder-b43e6145-f012-4c7f-abc8-cef8405e3e28-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:43:04 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5e78eda8-8c1e-44be-924a-19dd5af9858a tempest-VolumesGetTest-361458807 None] Acquiring lock "cinder-quobyte-ffdd794b-c897-424c-82c8-0a4fd3088065" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:04 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5e78eda8-8c1e-44be-924a-19dd5af9858a tempest-VolumesGetTest-361458807 None] Lock "cinder-quobyte-ffdd794b-c897-424c-82c8-0a4fd3088065" acquired by "delete_volume" :: waited 0.029s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:04 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d7c337-2833-409a-8070-c6e141e06cec]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:43:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5e78eda8-8c1e-44be-924a-19dd5af9858a tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:04 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-61108fe4-e648-46ad-b5eb-dea07e87d392 tempest-VolumesExtendTest-1940863257 None] Acquiring lock "cinder-bf4dbb2f-1865-436d-a403-e44b1f730e82-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:04 devstack sudo[102140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065 Nov 02 15:43:04 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:04 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-61108fe4-e648-46ad-b5eb-dea07e87d392 tempest-VolumesExtendTest-1940863257 None] Lock "cinder-bf4dbb2f-1865-436d-a403-e44b1f730e82-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:04 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-61108fe4-e648-46ad-b5eb-dea07e87d392 tempest-VolumesExtendTest-1940863257 None] Acquiring lock "cinder-quobyte-bf4dbb2f-1865-436d-a403-e44b1f730e82" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:04 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-61108fe4-e648-46ad-b5eb-dea07e87d392 tempest-VolumesExtendTest-1940863257 None] Lock "cinder-quobyte-bf4dbb2f-1865-436d-a403-e44b1f730e82" acquired by "delete_volume" :: waited 0.022s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:04 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0895543b-b823-4ec5-b62c-90492adbc533]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:43:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-61108fe4-e648-46ad-b5eb-dea07e87d392 tempest-VolumesExtendTest-1940863257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf4dbb2f-1865-436d-a403-e44b1f730e82 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:04 devstack sudo[102142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf4dbb2f-1865-436d-a403-e44b1f730e82 Nov 02 15:43:04 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:04 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5e78eda8-8c1e-44be-924a-19dd5af9858a tempest-VolumesGetTest-361458807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065" returned: 0 in 0.442s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5e78eda8-8c1e-44be-924a-19dd5af9858a tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:04 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065 Nov 02 15:43:04 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:04 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-61108fe4-e648-46ad-b5eb-dea07e87d392 tempest-VolumesExtendTest-1940863257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf4dbb2f-1865-436d-a403-e44b1f730e82" returned: 0 in 0.442s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-61108fe4-e648-46ad-b5eb-dea07e87d392 tempest-VolumesExtendTest-1940863257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf4dbb2f-1865-436d-a403-e44b1f730e82 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:04 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:04 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf4dbb2f-1865-436d-a403-e44b1f730e82 Nov 02 15:43:04 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5e78eda8-8c1e-44be-924a-19dd5af9858a tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ffdd794b-c897-424c-82c8-0a4fd3088065" returned: 0 in 0.301s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:04 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5e78eda8-8c1e-44be-924a-19dd5af9858a tempest-VolumesGetTest-361458807 None] Lock "cinder-quobyte-ffdd794b-c897-424c-82c8-0a4fd3088065" released by "delete_volume" :: held 0.824s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:43:04 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-5e78eda8-8c1e-44be-924a-19dd5af9858a tempest-VolumesGetTest-361458807 None] Created reservations ['975463c9-ae98-4b83-bdec-409659424589', '3441b142-8747-47b5-b50e-c5597eba7fab', '550f168a-bbe5-4ba6-8e74-c1bbe83479a9', '89903877-a8e4-48c9-a943-052f00532bcb'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:43:05 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-61108fe4-e648-46ad-b5eb-dea07e87d392 tempest-VolumesExtendTest-1940863257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bf4dbb2f-1865-436d-a403-e44b1f730e82" returned: 0 in 0.275s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:05 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-61108fe4-e648-46ad-b5eb-dea07e87d392 tempest-VolumesExtendTest-1940863257 None] Lock "cinder-quobyte-bf4dbb2f-1865-436d-a403-e44b1f730e82" released by "delete_volume" :: held 0.770s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:43:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5e78eda8-8c1e-44be-924a-19dd5af9858a tempest-VolumesGetTest-361458807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5e78eda8-8c1e-44be-924a-19dd5af9858a tempest-VolumesGetTest-361458807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:05 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-5e78eda8-8c1e-44be-924a-19dd5af9858a tempest-VolumesGetTest-361458807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:43:05 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-5e78eda8-8c1e-44be-924a-19dd5af9858a tempest-VolumesGetTest-361458807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:43:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5e78eda8-8c1e-44be-924a-19dd5af9858a tempest-VolumesGetTest-361458807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5e78eda8-8c1e-44be-924a-19dd5af9858a tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:05 devstack sudo[102157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:43:05 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:05 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-61108fe4-e648-46ad-b5eb-dea07e87d392 tempest-VolumesExtendTest-1940863257 None] Created reservations ['78d0796f-8bdd-48d2-b34e-5955c8ee4505', '29c2f27e-47f3-49e0-99f2-93e2a6ad58ae', '0c50e063-4958-48be-92c3-136f04b8607c', '59a1c7df-4999-4eec-bdea-a133deaf31e9'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:43:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-61108fe4-e648-46ad-b5eb-dea07e87d392 tempest-VolumesExtendTest-1940863257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-61108fe4-e648-46ad-b5eb-dea07e87d392 tempest-VolumesExtendTest-1940863257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:05 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-61108fe4-e648-46ad-b5eb-dea07e87d392 tempest-VolumesExtendTest-1940863257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:43:05 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-61108fe4-e648-46ad-b5eb-dea07e87d392 tempest-VolumesExtendTest-1940863257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:43:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-61108fe4-e648-46ad-b5eb-dea07e87d392 tempest-VolumesExtendTest-1940863257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-61108fe4-e648-46ad-b5eb-dea07e87d392 tempest-VolumesExtendTest-1940863257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:05 devstack sudo[102159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:43:05 devstack sudo[102159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:05 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5e78eda8-8c1e-44be-924a-19dd5af9858a tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.338s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:05 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-5e78eda8-8c1e-44be-924a-19dd5af9858a tempest-VolumesGetTest-361458807 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:43:05 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-5e78eda8-8c1e-44be-924a-19dd5af9858a tempest-VolumesGetTest-361458807 None] Deleted volume successfully. Nov 02 15:43:05 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5e78eda8-8c1e-44be-924a-19dd5af9858a tempest-VolumesGetTest-361458807 None] Lock "cinder-ffdd794b-c897-424c-82c8-0a4fd3088065-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:43:05 devstack sudo[102159]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-61108fe4-e648-46ad-b5eb-dea07e87d392 tempest-VolumesExtendTest-1940863257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.317s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:05 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-61108fe4-e648-46ad-b5eb-dea07e87d392 tempest-VolumesExtendTest-1940863257 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:43:05 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-61108fe4-e648-46ad-b5eb-dea07e87d392 tempest-VolumesExtendTest-1940863257 None] Deleted volume successfully. Nov 02 15:43:05 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-61108fe4-e648-46ad-b5eb-dea07e87d392 tempest-VolumesExtendTest-1940863257 None] Lock "cinder-bf4dbb2f-1865-436d-a403-e44b1f730e82-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:43:06 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:43:06 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] Flow 'volume_create_manager' (4e8c8fd7-d1ed-4541-9c54-e581019202f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:43:06 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a885eb-ce83-4462-8098-30512544b7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:06 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a885eb-ce83-4462-8098-30512544b7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-456850692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f22de521-1706-41ef-8b04-ef3cdbe780b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7299c6c02e604d34bd5facac7ab37ede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:43:06Z,use_quota=True,user_id='12b2ba9639484217b0e6d1fe497b5173',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:06 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7bf7bae-fc0f-42a5-bdea-6065fdc34e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:06 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7bf7bae-fc0f-42a5-bdea-6065fdc34e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:06 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b63f70-7c15-44a3-94ee-e23b4631065a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:06 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17b63f70-7c15-44a3-94ee-e23b4631065a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f22de521-1706-41ef-8b04-ef3cdbe780b4', 'volume_name': 'volume-f22de521-1706-41ef-8b04-ef3cdbe780b4', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:06 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1abba8d3-8459-4db8-9c97-bca45797a55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:06 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1abba8d3-8459-4db8-9c97-bca45797a55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:06 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ef4f199-5931-4485-9b80-f3d4f1d73506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:06 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] Volume f22de521-1706-41ef-8b04-ef3cdbe780b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f22de521-1706-41ef-8b04-ef3cdbe780b4', 'volume_size': 1} Nov 02 15:43:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:06 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-456850692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f22de521-1706-41ef-8b04-ef3cdbe780b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7299c6c02e604d34bd5facac7ab37ede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:43:06Z,use_quota=True,user_id='12b2ba9639484217b0e6d1fe497b5173',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:43:06 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] Creating volume f22de521-1706-41ef-8b04-ef3cdbe780b4 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:43:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:06 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:43:06 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:43:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:06 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:43:06 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:43:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:06 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4 1073741824 Nov 02 15:43:06 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:06 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4 1073741824" returned: 0 in 0.651s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:06 devstack sudo[102170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4 Nov 02 15:43:06 devstack sudo[102170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:07 devstack sudo[102170]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4" returned: 0 in 0.298s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:07 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:43:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:07 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ef4f199-5931-4485-9b80-f3d4f1d73506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f22de521-1706-41ef-8b04-ef3cdbe780b4', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:07 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc01854d-7988-40b6-ac29-cb7be3fbb972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:07 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] Volume volume-f22de521-1706-41ef-8b04-ef3cdbe780b4 (f22de521-1706-41ef-8b04-ef3cdbe780b4): created successfully Nov 02 15:43:07 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc01854d-7988-40b6-ac29-cb7be3fbb972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:07 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] Flow 'volume_create_manager' (4e8c8fd7-d1ed-4541-9c54-e581019202f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:43:07 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:43:07 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Flow 'volume_create_manager' (00a41685-9344-404e-95a9-ca6aa3b4d564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:43:07 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc844f1-52ee-43ea-ae52-03c9a54781d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:07 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-78139163-152a-43ad-96ad-90dc4af630d6 tempest-VolumesExtendTest-1940863257 None] Created volume successfully. Nov 02 15:43:07 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc844f1-52ee-43ea-ae52-03c9a54781d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-421317902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a136e170-f5f5-4788-8e4e-48a8bc32c0b5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e8d704b8acea42669f54bf4850039cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:43:07Z,use_quota=True,user_id='f00e846dab1a4cfcb99f544db61cdcfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:07 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3b8655-23bd-49ae-b0f7-83932ea693d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:07 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3b8655-23bd-49ae-b0f7-83932ea693d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:07 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (798e843f-4518-4c68-a06a-ffeea03f7789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:07 devstack cinder-volume[86703]: DEBUG cinder.image.glance [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Creating Keystone auth plugin from conf {{(pid=86703) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 15:43:07 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (798e843f-4518-4c68-a06a-ffeea03f7789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a136e170-f5f5-4788-8e4e-48a8bc32c0b5', 'volume_name': 'volume-a136e170-f5f5-4788-8e4e-48a8bc32c0b5', 'volume_size': 1, 'image_id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '583ef2b19215459298db002053800c52', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'created_at': datetime.datetime(2026, 11, 2, 14, 23, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 14, 23, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:07 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9116da0-9fd3-41b3-ab06-95f568846998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:07 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9116da0-9fd3-41b3-ab06-95f568846998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:07 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fae1457-6a99-407d-b06b-720305b88240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:07 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Volume a136e170-f5f5-4788-8e4e-48a8bc32c0b5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a136e170-f5f5-4788-8e4e-48a8bc32c0b5', 'volume_size': 1, 'image_id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '583ef2b19215459298db002053800c52', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'created_at': datetime.datetime(2026, 11, 2, 14, 23, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 14, 23, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 15:43:07 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Trying to clone a136e170-f5f5-4788-8e4e-48a8bc32c0b5 from image 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 at location (None, [{'url': 'file:///opt/stack/data/glance/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'metadata': {}}]). {{(pid=86703) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 15:43:07 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_bwidq4k5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86703) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 15:43:07 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Image download 20.69 MB at 20.69 MB/s Nov 02 15:43:08 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0979374d-ac65-483b-90f1-5ac839d534bc]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:43:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_bwidq4k5devstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:08 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_bwidq4k5devstack@QuobyteHD Nov 02 15:43:08 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-888d8ef3-11af-4bcb-b2dd-40b6453ec3b7 tempest-VolumesExtendTest-1940863257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-888d8ef3-11af-4bcb-b2dd-40b6453ec3b7 tempest-VolumesExtendTest-1940863257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:08 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-888d8ef3-11af-4bcb-b2dd-40b6453ec3b7 tempest-VolumesExtendTest-1940863257 None] Creating offline snapshot ac7304d4-54e9-4a83-bb17-e8d376c51c27 of volume f22de521-1706-41ef-8b04-ef3cdbe780b4 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:43:08 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_bwidq4k5devstack@QuobyteHD" returned: 0 in 0.458s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:08 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Temporary image 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 is fetched for user f00e846dab1a4cfcb99f544db61cdcfe. {{(pid=86703) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 15:43:08 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7477e25a-72f1-452a-9e6c-9413eb9c0105]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:43:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-888d8ef3-11af-4bcb-b2dd-40b6453ec3b7 tempest-VolumesExtendTest-1940863257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:08 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f6f034-d48e-4cb6-8945-6b1c4db4fb59]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:43:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_bwidq4k5devstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:08 devstack sudo[102180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4 Nov 02 15:43:08 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:08 devstack sudo[102181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_bwidq4k5devstack@QuobyteHD Nov 02 15:43:08 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:08 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_bwidq4k5devstack@QuobyteHD" returned: 0 in 0.371s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:08 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-888d8ef3-11af-4bcb-b2dd-40b6453ec3b7 tempest-VolumesExtendTest-1940863257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4" returned: 0 in 0.482s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-888d8ef3-11af-4bcb-b2dd-40b6453ec3b7 tempest-VolumesExtendTest-1940863257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4.ac7304d4-54e9-4a83-bb17-e8d376c51c27 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:09 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4.ac7304d4-54e9-4a83-bb17-e8d376c51c27 1G Nov 02 15:43:09 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:09 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-888d8ef3-11af-4bcb-b2dd-40b6453ec3b7 tempest-VolumesExtendTest-1940863257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4.ac7304d4-54e9-4a83-bb17-e8d376c51c27 1G" returned: 0 in 0.594s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-888d8ef3-11af-4bcb-b2dd-40b6453ec3b7 tempest-VolumesExtendTest-1940863257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f22de521-1706-41ef-8b04-ef3cdbe780b4 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4.ac7304d4-54e9-4a83-bb17-e8d376c51c27 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:09 devstack sudo[102197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f22de521-1706-41ef-8b04-ef3cdbe780b4 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4.ac7304d4-54e9-4a83-bb17-e8d376c51c27 Nov 02 15:43:09 devstack sudo[102197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:09 devstack sudo[102197]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-888d8ef3-11af-4bcb-b2dd-40b6453ec3b7 tempest-VolumesExtendTest-1940863257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f22de521-1706-41ef-8b04-ef3cdbe780b4 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4.ac7304d4-54e9-4a83-bb17-e8d376c51c27" returned: 0 in 0.290s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:09 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-888d8ef3-11af-4bcb-b2dd-40b6453ec3b7 tempest-VolumesExtendTest-1940863257 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4.ac7304d4-54e9-4a83-bb17-e8d376c51c27 is being set with open permissions: ugo+rw Nov 02 15:43:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-888d8ef3-11af-4bcb-b2dd-40b6453ec3b7 tempest-VolumesExtendTest-1940863257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4.ac7304d4-54e9-4a83-bb17-e8d376c51c27 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:09 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4.ac7304d4-54e9-4a83-bb17-e8d376c51c27 Nov 02 15:43:09 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:10 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-888d8ef3-11af-4bcb-b2dd-40b6453ec3b7 tempest-VolumesExtendTest-1940863257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4.ac7304d4-54e9-4a83-bb17-e8d376c51c27" returned: 0 in 0.244s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-888d8ef3-11af-4bcb-b2dd-40b6453ec3b7 tempest-VolumesExtendTest-1940863257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:10 devstack sudo[102205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4.info Nov 02 15:43:10 devstack sudo[102205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:10 devstack sudo[102205]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-888d8ef3-11af-4bcb-b2dd-40b6453ec3b7 tempest-VolumesExtendTest-1940863257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4.info" returned: 0 in 0.269s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:10 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-888d8ef3-11af-4bcb-b2dd-40b6453ec3b7 tempest-VolumesExtendTest-1940863257 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4.info is being set with open permissions: ugo+rw Nov 02 15:43:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-888d8ef3-11af-4bcb-b2dd-40b6453ec3b7 tempest-VolumesExtendTest-1940863257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:10 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4.info Nov 02 15:43:10 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:10 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-888d8ef3-11af-4bcb-b2dd-40b6453ec3b7 tempest-VolumesExtendTest-1940863257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4.info" returned: 0 in 0.292s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-888d8ef3-11af-4bcb-b2dd-40b6453ec3b7 tempest-VolumesExtendTest-1940863257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.290s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.768s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-421317902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a136e170-f5f5-4788-8e4e-48a8bc32c0b5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e8d704b8acea42669f54bf4850039cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:43:07Z,use_quota=True,user_id='f00e846dab1a4cfcb99f544db61cdcfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:43:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Creating volume a136e170-f5f5-4788-8e4e-48a8bc32c0b5 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:43:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:43:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:43:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:43:10 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:43:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a136e170-f5f5-4788-8e4e-48a8bc32c0b5 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:10 devstack sudo[102211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a136e170-f5f5-4788-8e4e-48a8bc32c0b5 1073741824 Nov 02 15:43:10 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:10 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-888d8ef3-11af-4bcb-b2dd-40b6453ec3b7 tempest-VolumesExtendTest-1940863257 None] Create snapshot completed successfully Nov 02 15:43:11 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a136e170-f5f5-4788-8e4e-48a8bc32c0b5 1073741824" returned: 0 in 0.515s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a136e170-f5f5-4788-8e4e-48a8bc32c0b5 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:11 devstack sudo[102217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a136e170-f5f5-4788-8e4e-48a8bc32c0b5 Nov 02 15:43:11 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:11 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a136e170-f5f5-4788-8e4e-48a8bc32c0b5" returned: 0 in 0.278s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:11 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:43:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:11 devstack cinder-volume[86703]: DEBUG cinder.volume.volume_utils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Attempting download of 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 ((None, [{'url': 'file:///opt/stack/data/glance/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'metadata': {}}])) to volume a136e170-f5f5-4788-8e4e-48a8bc32c0b5. {{(pid=86703) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 15:43:11 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d462c2c2-f8f6-4ea5-91a7-0ebe3024f299]: (4, 'raw') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:43:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_xwlzg4cv {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1379125f-fb7b-4f6c-bb8b-d18e9aa60452 tempest-VolumesExtendTest-1940863257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1379125f-fb7b-4f6c-bb8b-d18e9aa60452 tempest-VolumesExtendTest-1940863257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:11 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ddc364-a47a-4135-8a93-a62e0c285406]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:43:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1379125f-fb7b-4f6c-bb8b-d18e9aa60452 tempest-VolumesExtendTest-1940863257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:11 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_xwlzg4cv Nov 02 15:43:11 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:11 devstack sudo[102221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4 Nov 02 15:43:11 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:12 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_xwlzg4cv" returned: 0 in 0.344s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_xwlzg4cv {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:12 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1379125f-fb7b-4f6c-bb8b-d18e9aa60452 tempest-VolumesExtendTest-1940863257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4" returned: 0 in 0.391s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:12 devstack sudo[102226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_xwlzg4cv Nov 02 15:43:12 devstack sudo[102226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1379125f-fb7b-4f6c-bb8b-d18e9aa60452 tempest-VolumesExtendTest-1940863257 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4.ac7304d4-54e9-4a83-bb17-e8d376c51c27 2G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1379125f-fb7b-4f6c-bb8b-d18e9aa60452 tempest-VolumesExtendTest-1940863257 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4.ac7304d4-54e9-4a83-bb17-e8d376c51c27 2G" returned: 0 in 0.179s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1379125f-fb7b-4f6c-bb8b-d18e9aa60452 tempest-VolumesExtendTest-1940863257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.614s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:12 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-1379125f-fb7b-4f6c-bb8b-d18e9aa60452 tempest-VolumesExtendTest-1940863257 None] Extend volume completed successfully. Nov 02 15:43:12 devstack sudo[102226]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_xwlzg4cv" returned: 1 in 0.364s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_xwlzg4cv' failed. Not Retrying. {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 15:43:12 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[32aa9e12-e4b5-4cfb-93cd-f7954ce61497]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:43:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_bwidq4k5devstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:12 devstack sudo[102238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_bwidq4k5devstack@QuobyteHD Nov 02 15:43:12 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:12 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_bwidq4k5devstack@QuobyteHD" returned: 0 in 0.342s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:12 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 was qcow2, converting to qcow2 {{(pid=86703) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 15:43:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_bwidq4k5devstack@QuobyteHD /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a136e170-f5f5-4788-8e4e-48a8bc32c0b5 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:12 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_bwidq4k5devstack@QuobyteHD /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a136e170-f5f5-4788-8e4e-48a8bc32c0b5 Nov 02 15:43:12 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:13 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5bd47273-f113-430a-92c2-ac63729587eb tempest-VolumesExtendTest-1940863257 None] Acquiring lock "cinder-ac7304d4-54e9-4a83-bb17-e8d376c51c27-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:13 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5bd47273-f113-430a-92c2-ac63729587eb tempest-VolumesExtendTest-1940863257 None] Lock "cinder-ac7304d4-54e9-4a83-bb17-e8d376c51c27-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:13 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5bd47273-f113-430a-92c2-ac63729587eb tempest-VolumesExtendTest-1940863257 None] Acquiring lock "cinder-quobyte-f22de521-1706-41ef-8b04-ef3cdbe780b4" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:13 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5bd47273-f113-430a-92c2-ac63729587eb tempest-VolumesExtendTest-1940863257 None] Lock "cinder-quobyte-f22de521-1706-41ef-8b04-ef3cdbe780b4" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:13 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5bd47273-f113-430a-92c2-ac63729587eb tempest-VolumesExtendTest-1940863257 None] Acquiring lock "cinder-quobyte-ac7304d4-54e9-4a83-bb17-e8d376c51c27" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:13 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5bd47273-f113-430a-92c2-ac63729587eb tempest-VolumesExtendTest-1940863257 None] Lock "cinder-quobyte-ac7304d4-54e9-4a83-bb17-e8d376c51c27" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:13 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-5bd47273-f113-430a-92c2-ac63729587eb tempest-VolumesExtendTest-1940863257 None] Deleting offline snapshot ac7304d4-54e9-4a83-bb17-e8d376c51c27 of volume f22de521-1706-41ef-8b04-ef3cdbe780b4 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:43:13 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-5bd47273-f113-430a-92c2-ac63729587eb tempest-VolumesExtendTest-1940863257 None] snapshot_file for this snap is: volume-f22de521-1706-41ef-8b04-ef3cdbe780b4.ac7304d4-54e9-4a83-bb17-e8d376c51c27 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:43:13 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[648df675-1874-4502-a27c-fa085a3d3596]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:43:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5bd47273-f113-430a-92c2-ac63729587eb tempest-VolumesExtendTest-1940863257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4.ac7304d4-54e9-4a83-bb17-e8d376c51c27 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:13 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4.ac7304d4-54e9-4a83-bb17-e8d376c51c27 Nov 02 15:43:13 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:13 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5bd47273-f113-430a-92c2-ac63729587eb tempest-VolumesExtendTest-1940863257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4.ac7304d4-54e9-4a83-bb17-e8d376c51c27" returned: 0 in 0.495s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:13 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-5bd47273-f113-430a-92c2-ac63729587eb tempest-VolumesExtendTest-1940863257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f22de521-1706-41ef-8b04-ef3cdbe780b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:43:13 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04a9191-5082-4d9c-9408-96564fa5ea68]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:43:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5bd47273-f113-430a-92c2-ac63729587eb tempest-VolumesExtendTest-1940863257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:13 devstack sudo[102257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4 Nov 02 15:43:13 devstack sudo[102257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:13 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:43:13 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Flow 'volume_create_manager' (7dcec4b6-18d7-446c-b14d-048dad3ef038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:43:13 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65870dcd-93da-42b6-a303-e77149b43621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:13 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65870dcd-93da-42b6-a303-e77149b43621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-229725735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba3c99cc-5784-4c45-97fa-241790a249d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0fb066fa2024053a7afcf3a4a3ee28c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:43:14Z,use_quota=True,user_id='544413255548416798b6fc2b953689e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:13 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31adaa60-2cc7-4d0a-b57d-70aff6e0312b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:13 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31adaa60-2cc7-4d0a-b57d-70aff6e0312b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:13 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52736f5b-aad4-4f7f-811d-d57481dded18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:13 devstack cinder-volume[86703]: DEBUG cinder.image.glance [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Creating Keystone auth plugin from conf {{(pid=86703) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 15:43:14 devstack sudo[102257]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5bd47273-f113-430a-92c2-ac63729587eb tempest-VolumesExtendTest-1940863257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4" returned: 0 in 0.428s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5bd47273-f113-430a-92c2-ac63729587eb tempest-VolumesExtendTest-1940863257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4.ac7304d4-54e9-4a83-bb17-e8d376c51c27 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:14 devstack sudo[102262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4.ac7304d4-54e9-4a83-bb17-e8d376c51c27 Nov 02 15:43:14 devstack sudo[102262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:14 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52736f5b-aad4-4f7f-811d-d57481dded18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ba3c99cc-5784-4c45-97fa-241790a249d8', 'volume_name': 'volume-ba3c99cc-5784-4c45-97fa-241790a249d8', 'volume_size': 1, 'image_id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '583ef2b19215459298db002053800c52', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'created_at': datetime.datetime(2026, 11, 2, 14, 23, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 14, 23, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:14 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (390dd207-fd75-4b7d-917a-fad82f47f99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:14 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (390dd207-fd75-4b7d-917a-fad82f47f99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:14 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90b5dd07-81cf-4ad0-b314-2a8e6986a813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:14 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Volume ba3c99cc-5784-4c45-97fa-241790a249d8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ba3c99cc-5784-4c45-97fa-241790a249d8', 'volume_size': 1, 'image_id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '583ef2b19215459298db002053800c52', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'created_at': datetime.datetime(2026, 11, 2, 14, 23, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 14, 23, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 02 15:43:14 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Trying to clone ba3c99cc-5784-4c45-97fa-241790a249d8 from image 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 at location (None, [{'url': 'file:///opt/stack/data/glance/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'metadata': {}}]). {{(pid=86703) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 15:43:14 devstack sudo[102262]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5bd47273-f113-430a-92c2-ac63729587eb tempest-VolumesExtendTest-1940863257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4.ac7304d4-54e9-4a83-bb17-e8d376c51c27" returned: 0 in 0.533s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5bd47273-f113-430a-92c2-ac63729587eb tempest-VolumesExtendTest-1940863257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4.ac7304d4-54e9-4a83-bb17-e8d376c51c27 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:14 devstack sudo[102267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4.ac7304d4-54e9-4a83-bb17-e8d376c51c27 Nov 02 15:43:14 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:14 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_uvq5vnmjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86703) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 15:43:14 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Image download 20.69 MB at 20.69 MB/s Nov 02 15:43:14 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26a807d-e856-45ec-84d3-2334ad2a53f2]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:43:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_uvq5vnmjdevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:14 devstack sudo[102270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_uvq5vnmjdevstack@QuobyteHD Nov 02 15:43:14 devstack sudo[102270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:14 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5bd47273-f113-430a-92c2-ac63729587eb tempest-VolumesExtendTest-1940863257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4.ac7304d4-54e9-4a83-bb17-e8d376c51c27" returned: 0 in 0.353s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:15 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_bwidq4k5devstack@QuobyteHD /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a136e170-f5f5-4788-8e4e-48a8bc32c0b5" returned: 0 in 2.256s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:15 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_bwidq4k5devstack@QuobyteHD, size 112.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a136e170-f5f5-4788-8e4e-48a8bc32c0b5 {{(pid=86703) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 15:43:15 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Converted 112.00 MB image at 49.62 MB/s Nov 02 15:43:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a136e170-f5f5-4788-8e4e-48a8bc32c0b5 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:15 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5bd47273-f113-430a-92c2-ac63729587eb tempest-VolumesExtendTest-1940863257 None] Lock "cinder-quobyte-ac7304d4-54e9-4a83-bb17-e8d376c51c27" released by "_delete_snapshot" :: held 1.975s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:43:15 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5bd47273-f113-430a-92c2-ac63729587eb tempest-VolumesExtendTest-1940863257 None] Lock "cinder-quobyte-f22de521-1706-41ef-8b04-ef3cdbe780b4" released by "delete_snapshot" :: held 2.008s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:43:15 devstack sudo[102273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a136e170-f5f5-4788-8e4e-48a8bc32c0b5 1G Nov 02 15:43:15 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:15 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-5bd47273-f113-430a-92c2-ac63729587eb tempest-VolumesExtendTest-1940863257 None] Created reservations ['463df3b4-ca12-41d7-ae40-1e0acad9184f', '077fdcbd-55f0-4f8c-9706-37f48bf514f6', '10029dbf-e989-41c8-93b7-8d190260b2f6', 'b772788d-faa7-409b-8c96-6b0855161f6e'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:43:15 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-5bd47273-f113-430a-92c2-ac63729587eb tempest-VolumesExtendTest-1940863257 None] Delete snapshot completed successfully. Nov 02 15:43:15 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5bd47273-f113-430a-92c2-ac63729587eb tempest-VolumesExtendTest-1940863257 None] Lock "cinder-ac7304d4-54e9-4a83-bb17-e8d376c51c27-delete_snapshot" released by "delete_snapshot" :: held 2.165s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:43:15 devstack sudo[102270]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_uvq5vnmjdevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:15 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Temporary image 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 is fetched for user 544413255548416798b6fc2b953689e8. {{(pid=86703) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 15:43:15 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8aa6bdf-32b5-4767-b764-6cbc7e439b35]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:43:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_uvq5vnmjdevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:15 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a136e170-f5f5-4788-8e4e-48a8bc32c0b5 1G" returned: 0 in 0.331s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:15 devstack cinder-volume[86703]: DEBUG cinder.volume.volume_utils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Downloaded image 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 ((None, [{'url': 'file:///opt/stack/data/glance/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'metadata': {}}])) to volume a136e170-f5f5-4788-8e4e-48a8bc32c0b5 successfully. {{(pid=86703) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 15:43:15 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Temporary image 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 for user f00e846dab1a4cfcb99f544db61cdcfe is deleted. {{(pid=86703) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 15:43:15 devstack cinder-volume[86703]: DEBUG cinder.volume.volume_utils [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Marking volume a136e170-f5f5-4788-8e4e-48a8bc32c0b5 as bootable. {{(pid=86703) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 15:43:15 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Copying metadata from image 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 to a136e170-f5f5-4788-8e4e-48a8bc32c0b5. {{(pid=86703) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 15:43:15 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Creating volume glance metadata for volume a136e170-f5f5-4788-8e4e-48a8bc32c0b5 backed by image 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86703) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 15:43:15 devstack sudo[102281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_uvq5vnmjdevstack@QuobyteHD Nov 02 15:43:15 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:15 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fae1457-6a99-407d-b06b-720305b88240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a136e170-f5f5-4788-8e4e-48a8bc32c0b5', 'volume_size': 1, 'image_id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '583ef2b19215459298db002053800c52', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'created_at': datetime.datetime(2026, 11, 2, 14, 23, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 14, 23, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:15 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54d54ad4-7c80-47f0-ba0f-716f35d53c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:15 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Volume volume-a136e170-f5f5-4788-8e4e-48a8bc32c0b5 (a136e170-f5f5-4788-8e4e-48a8bc32c0b5): created successfully Nov 02 15:43:15 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54d54ad4-7c80-47f0-ba0f-716f35d53c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:15 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Flow 'volume_create_manager' (00a41685-9344-404e-95a9-ca6aa3b4d564) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:43:15 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-9797179d-4d3f-406f-84aa-bc67036e3f49 tempest-VolumesGetTest-361458807 None] Created volume successfully. Nov 02 15:43:15 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_uvq5vnmjdevstack@QuobyteHD" returned: 0 in 0.341s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:15 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:43:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-229725735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba3c99cc-5784-4c45-97fa-241790a249d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0fb066fa2024053a7afcf3a4a3ee28c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:43:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:43:14Z,use_quota=True,user_id='544413255548416798b6fc2b953689e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:43:15 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Creating volume ba3c99cc-5784-4c45-97fa-241790a249d8 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:43:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:15 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:43:15 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:43:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:15 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:43:15 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:43:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ba3c99cc-5784-4c45-97fa-241790a249d8 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:15 devstack sudo[102287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ba3c99cc-5784-4c45-97fa-241790a249d8 1073741824 Nov 02 15:43:15 devstack sudo[102287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:16 devstack sudo[102287]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ba3c99cc-5784-4c45-97fa-241790a249d8 1073741824" returned: 0 in 0.435s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ba3c99cc-5784-4c45-97fa-241790a249d8 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:16 devstack sudo[102293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ba3c99cc-5784-4c45-97fa-241790a249d8 Nov 02 15:43:16 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-36263671-db31-4af3-bdea-111ef714460d tempest-VolumesExtendTest-1940863257 None] Acquiring lock "cinder-f22de521-1706-41ef-8b04-ef3cdbe780b4-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-36263671-db31-4af3-bdea-111ef714460d tempest-VolumesExtendTest-1940863257 None] Lock "cinder-f22de521-1706-41ef-8b04-ef3cdbe780b4-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-36263671-db31-4af3-bdea-111ef714460d tempest-VolumesExtendTest-1940863257 None] Acquiring lock "cinder-quobyte-f22de521-1706-41ef-8b04-ef3cdbe780b4" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-36263671-db31-4af3-bdea-111ef714460d tempest-VolumesExtendTest-1940863257 None] Lock "cinder-quobyte-f22de521-1706-41ef-8b04-ef3cdbe780b4" acquired by "delete_volume" :: waited 0.016s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:16 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ba3c99cc-5784-4c45-97fa-241790a249d8" returned: 0 in 0.313s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7874330-1af8-4921-91e3-66ab96733fc4]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-36263671-db31-4af3-bdea-111ef714460d tempest-VolumesExtendTest-1940863257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG cinder.volume.volume_utils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Attempting download of 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 ((None, [{'url': 'file:///opt/stack/data/glance/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'metadata': {}}])) to volume ba3c99cc-5784-4c45-97fa-241790a249d8. {{(pid=86703) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e660ac-b905-40f5-8015-966768fee85c]: (4, 'raw') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_7iqfjmpq {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:16 devstack sudo[102296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4 Nov 02 15:43:16 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:16 devstack sudo[102297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_7iqfjmpq Nov 02 15:43:16 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] Flow 'volume_create_manager' (bb530b16-a9a5-4243-b0bc-acf429563b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86192dcf-0912-47dc-849c-bd609326b764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86192dcf-0912-47dc-849c-bd609326b764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:43:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1025813932',display_name='tempest-VolumesGetTest-Volume-1757147881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3f56302-cb01-4538-a229-9f144286186f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8d704b8acea42669f54bf4850039cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:43:17Z,use_quota=True,user_id='f00e846dab1a4cfcb99f544db61cdcfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8bbd7e7-8696-4f8d-ac47-dc9d022b69da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8bbd7e7-8696-4f8d-ac47-dc9d022b69da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba9d85c-9c93-4fbd-be33-2db7c554ba6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ba9d85c-9c93-4fbd-be33-2db7c554ba6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3f56302-cb01-4538-a229-9f144286186f', 'volume_name': 'volume-f3f56302-cb01-4538-a229-9f144286186f', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b86e25-63e6-4c8f-8efd-c35d90838b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b86e25-63e6-4c8f-8efd-c35d90838b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a5a5d1-0e94-4e38-bd67-9e8e2e3658a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:16 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] Volume f3f56302-cb01-4538-a229-9f144286186f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3f56302-cb01-4538-a229-9f144286186f', 'volume_size': 1} Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:43:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1025813932',display_name='tempest-VolumesGetTest-Volume-1757147881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3f56302-cb01-4538-a229-9f144286186f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8d704b8acea42669f54bf4850039cd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:43:17Z,use_quota=True,user_id='f00e846dab1a4cfcb99f544db61cdcfe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] Creating volume f3f56302-cb01-4538-a229-9f144286186f {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:43:16 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f3f56302-cb01-4538-a229-9f144286186f 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:16 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-36263671-db31-4af3-bdea-111ef714460d tempest-VolumesExtendTest-1940863257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4" returned: 0 in 0.406s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-36263671-db31-4af3-bdea-111ef714460d tempest-VolumesExtendTest-1940863257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:16 devstack sudo[102303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f3f56302-cb01-4538-a229-9f144286186f 1073741824 Nov 02 15:43:16 devstack sudo[102303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:16 devstack sudo[102304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4 Nov 02 15:43:16 devstack sudo[102304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:16 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_7iqfjmpq" returned: 0 in 0.369s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_7iqfjmpq {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:17 devstack sudo[102309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_7iqfjmpq Nov 02 15:43:17 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:17 devstack sudo[102304]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-36263671-db31-4af3-bdea-111ef714460d tempest-VolumesExtendTest-1940863257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22de521-1706-41ef-8b04-ef3cdbe780b4" returned: 0 in 0.252s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:17 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-36263671-db31-4af3-bdea-111ef714460d tempest-VolumesExtendTest-1940863257 None] Lock "cinder-quobyte-f22de521-1706-41ef-8b04-ef3cdbe780b4" released by "delete_volume" :: held 0.744s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:43:17 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-36263671-db31-4af3-bdea-111ef714460d tempest-VolumesExtendTest-1940863257 None] Created reservations ['29b8de14-d78a-4623-b2f9-70d1a58a86cb', 'f13af06d-4b7f-4b16-8123-91f8cb136f7e', '112a5341-a4a6-4ff3-90e1-cd7a6c978d71', '6b687f98-8c9e-4a2c-abb8-3c0be8ad78ef'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:43:17 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_7iqfjmpq" returned: 1 in 0.337s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_7iqfjmpq' failed. Not Retrying. {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 15:43:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-36263671-db31-4af3-bdea-111ef714460d tempest-VolumesExtendTest-1940863257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-36263671-db31-4af3-bdea-111ef714460d tempest-VolumesExtendTest-1940863257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:17 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-36263671-db31-4af3-bdea-111ef714460d tempest-VolumesExtendTest-1940863257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:43:17 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-36263671-db31-4af3-bdea-111ef714460d tempest-VolumesExtendTest-1940863257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:43:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-36263671-db31-4af3-bdea-111ef714460d tempest-VolumesExtendTest-1940863257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-36263671-db31-4af3-bdea-111ef714460d tempest-VolumesExtendTest-1940863257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:17 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3829dd-ef8a-4998-ac35-047dd78a27b9]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:43:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_uvq5vnmjdevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:17 devstack sudo[102317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:43:17 devstack sudo[102317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:17 devstack sudo[102303]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f3f56302-cb01-4538-a229-9f144286186f 1073741824" returned: 0 in 0.473s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f3f56302-cb01-4538-a229-9f144286186f {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:17 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f3f56302-cb01-4538-a229-9f144286186f Nov 02 15:43:17 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:17 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_uvq5vnmjdevstack@QuobyteHD Nov 02 15:43:17 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:17 devstack sudo[102317]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-36263671-db31-4af3-bdea-111ef714460d tempest-VolumesExtendTest-1940863257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.301s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:17 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-36263671-db31-4af3-bdea-111ef714460d tempest-VolumesExtendTest-1940863257 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:43:17 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-36263671-db31-4af3-bdea-111ef714460d tempest-VolumesExtendTest-1940863257 None] Deleted volume successfully. Nov 02 15:43:17 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-36263671-db31-4af3-bdea-111ef714460d tempest-VolumesExtendTest-1940863257 None] Lock "cinder-f22de521-1706-41ef-8b04-ef3cdbe780b4-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:43:17 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:17 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_uvq5vnmjdevstack@QuobyteHD" returned: 0 in 0.392s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:17 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 was qcow2, converting to qcow2 {{(pid=86703) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 15:43:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_uvq5vnmjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ba3c99cc-5784-4c45-97fa-241790a249d8 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f3f56302-cb01-4538-a229-9f144286186f" returned: 0 in 0.340s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:17 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:43:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:17 devstack sudo[102328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_uvq5vnmjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ba3c99cc-5784-4c45-97fa-241790a249d8 Nov 02 15:43:17 devstack sudo[102328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4a5a5d1-0e94-4e38-bd67-9e8e2e3658a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3f56302-cb01-4538-a229-9f144286186f', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d2146e-20fe-45a0-a40e-db204bf8c1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:17 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] Volume volume-f3f56302-cb01-4538-a229-9f144286186f (f3f56302-cb01-4538-a229-9f144286186f): created successfully Nov 02 15:43:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d2146e-20fe-45a0-a40e-db204bf8c1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] Flow 'volume_create_manager' (bb530b16-a9a5-4243-b0bc-acf429563b28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:43:17 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-889c20c7-7b57-44ba-b0d2-10001c6a4a44 tempest-VolumesGetTest-361458807 None] Created volume successfully. Nov 02 15:43:19 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-aea6dd24-8a88-40ce-8582-ca6589677fa8 tempest-VolumesGetTest-361458807 None] Acquiring lock "cinder-f3f56302-cb01-4538-a229-9f144286186f-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:19 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-aea6dd24-8a88-40ce-8582-ca6589677fa8 tempest-VolumesGetTest-361458807 None] Lock "cinder-f3f56302-cb01-4538-a229-9f144286186f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:19 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-aea6dd24-8a88-40ce-8582-ca6589677fa8 tempest-VolumesGetTest-361458807 None] Acquiring lock "cinder-quobyte-f3f56302-cb01-4538-a229-9f144286186f" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:19 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-aea6dd24-8a88-40ce-8582-ca6589677fa8 tempest-VolumesGetTest-361458807 None] Lock "cinder-quobyte-f3f56302-cb01-4538-a229-9f144286186f" acquired by "delete_volume" :: waited 0.023s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:19 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[266cf1a2-dcb5-4c59-89e5-11898921dd0a]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:43:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-aea6dd24-8a88-40ce-8582-ca6589677fa8 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f3f56302-cb01-4538-a229-9f144286186f {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:19 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f3f56302-cb01-4538-a229-9f144286186f Nov 02 15:43:19 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:19 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-aea6dd24-8a88-40ce-8582-ca6589677fa8 tempest-VolumesGetTest-361458807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f3f56302-cb01-4538-a229-9f144286186f" returned: 0 in 0.434s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-aea6dd24-8a88-40ce-8582-ca6589677fa8 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f3f56302-cb01-4538-a229-9f144286186f {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:19 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f3f56302-cb01-4538-a229-9f144286186f Nov 02 15:43:19 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:19 devstack sudo[102328]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_uvq5vnmjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ba3c99cc-5784-4c45-97fa-241790a249d8" returned: 0 in 2.062s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:19 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_552d8be0-0ec6-48b4-b4f2-35bd64f81e09_uvq5vnmjdevstack@QuobyteHD, size 112.00 MB, duration 2.06 sec, destination /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ba3c99cc-5784-4c45-97fa-241790a249d8 {{(pid=86703) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 15:43:19 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Converted 112.00 MB image at 54.28 MB/s Nov 02 15:43:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ba3c99cc-5784-4c45-97fa-241790a249d8 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:19 devstack sudo[102343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ba3c99cc-5784-4c45-97fa-241790a249d8 1G Nov 02 15:43:19 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:19 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-aea6dd24-8a88-40ce-8582-ca6589677fa8 tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f3f56302-cb01-4538-a229-9f144286186f" returned: 0 in 0.278s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:19 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-aea6dd24-8a88-40ce-8582-ca6589677fa8 tempest-VolumesGetTest-361458807 None] Lock "cinder-quobyte-f3f56302-cb01-4538-a229-9f144286186f" released by "delete_volume" :: held 0.757s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:43:19 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-aea6dd24-8a88-40ce-8582-ca6589677fa8 tempest-VolumesGetTest-361458807 None] Created reservations ['71b6d127-1b77-49ab-9403-ea34ea6e1a6e', '00d82e13-ee7b-41ec-b21d-2f2dae0fcaa6', '14f99aaa-d6ce-4144-8de7-a5fe61c6e3ab', '2e038178-c774-467f-96de-f309a822e25b'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-aea6dd24-8a88-40ce-8582-ca6589677fa8 tempest-VolumesGetTest-361458807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-aea6dd24-8a88-40ce-8582-ca6589677fa8 tempest-VolumesGetTest-361458807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-aea6dd24-8a88-40ce-8582-ca6589677fa8 tempest-VolumesGetTest-361458807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-aea6dd24-8a88-40ce-8582-ca6589677fa8 tempest-VolumesGetTest-361458807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-aea6dd24-8a88-40ce-8582-ca6589677fa8 tempest-VolumesGetTest-361458807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-aea6dd24-8a88-40ce-8582-ca6589677fa8 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:20 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:43:20 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:20 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ba3c99cc-5784-4c45-97fa-241790a249d8 1G" returned: 0 in 0.388s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG cinder.volume.volume_utils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Downloaded image 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 ((None, [{'url': 'file:///opt/stack/data/glance/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'metadata': {}}])) to volume ba3c99cc-5784-4c45-97fa-241790a249d8 successfully. {{(pid=86703) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Temporary image 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 for user 544413255548416798b6fc2b953689e8 is deleted. {{(pid=86703) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG cinder.volume.volume_utils [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Marking volume ba3c99cc-5784-4c45-97fa-241790a249d8 as bootable. {{(pid=86703) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Copying metadata from image 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 to ba3c99cc-5784-4c45-97fa-241790a249d8. {{(pid=86703) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Creating volume glance metadata for volume ba3c99cc-5784-4c45-97fa-241790a249d8 backed by image 552d8be0-0ec6-48b4-b4f2-35bd64f81e09 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86703) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90b5dd07-81cf-4ad0-b314-2a8e6986a813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba3c99cc-5784-4c45-97fa-241790a249d8', 'volume_size': 1, 'image_id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '583ef2b19215459298db002053800c52', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '552d8be0-0ec6-48b4-b4f2-35bd64f81e09', 'created_at': datetime.datetime(2026, 11, 2, 14, 23, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 14, 23, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/552d8be0-0ec6-48b4-b4f2-35bd64f81e09/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253fbe3b-49ff-4f25-9eea-2d63c6a499ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:20 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Volume volume-ba3c99cc-5784-4c45-97fa-241790a249d8 (ba3c99cc-5784-4c45-97fa-241790a249d8): created successfully Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253fbe3b-49ff-4f25-9eea-2d63c6a499ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Flow 'volume_create_manager' (7dcec4b6-18d7-446c-b14d-048dad3ef038) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:43:20 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-040548cc-0a6c-4deb-904f-283bc1537974 tempest-TestShelveInstance-1430468173 None] Created volume successfully. Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b277d5ce-fada-40a6-8de9-455c0992bb30 tempest-VolumesGetTest-361458807 None] Acquiring lock "cinder-a136e170-f5f5-4788-8e4e-48a8bc32c0b5-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:20 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b277d5ce-fada-40a6-8de9-455c0992bb30 tempest-VolumesGetTest-361458807 None] Lock "cinder-a136e170-f5f5-4788-8e4e-48a8bc32c0b5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-aea6dd24-8a88-40ce-8582-ca6589677fa8 tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.333s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-aea6dd24-8a88-40ce-8582-ca6589677fa8 tempest-VolumesGetTest-361458807 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:43:20 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-aea6dd24-8a88-40ce-8582-ca6589677fa8 tempest-VolumesGetTest-361458807 None] Deleted volume successfully. Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-aea6dd24-8a88-40ce-8582-ca6589677fa8 tempest-VolumesGetTest-361458807 None] Lock "cinder-f3f56302-cb01-4538-a229-9f144286186f-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b277d5ce-fada-40a6-8de9-455c0992bb30 tempest-VolumesGetTest-361458807 None] Acquiring lock "cinder-quobyte-a136e170-f5f5-4788-8e4e-48a8bc32c0b5" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b277d5ce-fada-40a6-8de9-455c0992bb30 tempest-VolumesGetTest-361458807 None] Lock "cinder-quobyte-a136e170-f5f5-4788-8e4e-48a8bc32c0b5" acquired by "delete_volume" :: waited 0.016s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd6e0c6-af38-48dc-8030-5a10fe25fc96]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b277d5ce-fada-40a6-8de9-455c0992bb30 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a136e170-f5f5-4788-8e4e-48a8bc32c0b5 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:20 devstack sudo[102352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a136e170-f5f5-4788-8e4e-48a8bc32c0b5 Nov 02 15:43:20 devstack sudo[102352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:20 devstack sudo[102354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:43:20 devstack sudo[102354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:20 devstack sudo[102352]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b277d5ce-fada-40a6-8de9-455c0992bb30 tempest-VolumesGetTest-361458807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a136e170-f5f5-4788-8e4e-48a8bc32c0b5" returned: 0 in 0.377s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b277d5ce-fada-40a6-8de9-455c0992bb30 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a136e170-f5f5-4788-8e4e-48a8bc32c0b5 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:20 devstack sudo[102360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a136e170-f5f5-4788-8e4e-48a8bc32c0b5 Nov 02 15:43:20 devstack sudo[102360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:20 devstack sudo[102354]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.259s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager._thread_info {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread count: 29 {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 15:43:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread info: [<_MainThread(MainThread, started 125876361756800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 15:43:21 devstack sudo[102360]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b277d5ce-fada-40a6-8de9-455c0992bb30 tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a136e170-f5f5-4788-8e4e-48a8bc32c0b5" returned: 0 in 0.254s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:21 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b277d5ce-fada-40a6-8de9-455c0992bb30 tempest-VolumesGetTest-361458807 None] Lock "cinder-quobyte-a136e170-f5f5-4788-8e4e-48a8bc32c0b5" released by "delete_volume" :: held 0.682s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:43:21 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-b277d5ce-fada-40a6-8de9-455c0992bb30 tempest-VolumesGetTest-361458807 None] Created reservations ['7189dd15-05e4-47a2-9bf2-992c23586376', '58ace065-07f1-4d89-93d4-2e6f52615ecb', '7500789a-6609-4064-ae70-507eae2d0bf3', '3c81b4ac-f3c5-4bc1-be20-543c50a04622'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:43:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b277d5ce-fada-40a6-8de9-455c0992bb30 tempest-VolumesGetTest-361458807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b277d5ce-fada-40a6-8de9-455c0992bb30 tempest-VolumesGetTest-361458807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:21 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b277d5ce-fada-40a6-8de9-455c0992bb30 tempest-VolumesGetTest-361458807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:43:21 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b277d5ce-fada-40a6-8de9-455c0992bb30 tempest-VolumesGetTest-361458807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:43:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b277d5ce-fada-40a6-8de9-455c0992bb30 tempest-VolumesGetTest-361458807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b277d5ce-fada-40a6-8de9-455c0992bb30 tempest-VolumesGetTest-361458807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:21 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:43:21 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:21 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b277d5ce-fada-40a6-8de9-455c0992bb30 tempest-VolumesGetTest-361458807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.306s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:21 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-b277d5ce-fada-40a6-8de9-455c0992bb30 tempest-VolumesGetTest-361458807 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:43:21 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-b277d5ce-fada-40a6-8de9-455c0992bb30 tempest-VolumesGetTest-361458807 None] Deleted volume successfully. Nov 02 15:43:21 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b277d5ce-fada-40a6-8de9-455c0992bb30 tempest-VolumesGetTest-361458807 None] Lock "cinder-a136e170-f5f5-4788-8e4e-48a8bc32c0b5-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:43:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-b2ec83e6-123f-4a5b-8525-adfc98338e06 req-5ab82f02-68ea-4635-9e7c-9a5428da9563 tempest-TestShelveInstance-1430468173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-b2ec83e6-123f-4a5b-8525-adfc98338e06 req-5ab82f02-68ea-4635-9e7c-9a5428da9563 tempest-TestShelveInstance-1430468173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-b2ec83e6-123f-4a5b-8525-adfc98338e06 req-5ab82f02-68ea-4635-9e7c-9a5428da9563 tempest-TestShelveInstance-1430468173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-b2ec83e6-123f-4a5b-8525-adfc98338e06 req-5ab82f02-68ea-4635-9e7c-9a5428da9563 tempest-TestShelveInstance-1430468173 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478', 'name': 'volume-ba3c99cc-5784-4c45-97fa-241790a249d8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fe4ab3a5-8913-49f5-b299-53efbb327ffd', 'enforce_multipath': True} {{(pid=86703) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 15:43:24 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-b2ec83e6-123f-4a5b-8525-adfc98338e06 req-5ab82f02-68ea-4635-9e7c-9a5428da9563 tempest-TestShelveInstance-1430468173 None] attachment_update completed successfully. Nov 02 15:43:25 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:43:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Flow 'volume_create_manager' (9b478974-64ba-41e3-b398-c060d8660b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:43:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ae4c1b-fa1d-456e-988d-a6f8d93870fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ae4c1b-fa1d-456e-988d-a6f8d93870fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1862322543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca3d885-7384-4824-a101-dfe1e0db0496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677f5ffbc0d04d7ea4645287cd07a4fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:43:25Z,use_quota=True,user_id='4aa67c03297c405fa4d5eb6510e3ba68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b176dfb5-bad4-4043-938c-d217825c570c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b176dfb5-bad4-4043-938c-d217825c570c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c72be274-b1eb-4fe3-a698-633483cabe42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c72be274-b1eb-4fe3-a698-633483cabe42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ca3d885-7384-4824-a101-dfe1e0db0496', 'volume_name': 'volume-6ca3d885-7384-4824-a101-dfe1e0db0496', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0754d9d2-89c8-4ae1-b984-b3631e82c43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0754d9d2-89c8-4ae1-b984-b3631e82c43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e0694d7-4892-480f-9b3b-478be7eed3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:25 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Volume 6ca3d885-7384-4824-a101-dfe1e0db0496: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ca3d885-7384-4824-a101-dfe1e0db0496', 'volume_size': 1} Nov 02 15:43:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1862322543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ca3d885-7384-4824-a101-dfe1e0db0496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677f5ffbc0d04d7ea4645287cd07a4fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:43:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:43:25Z,use_quota=True,user_id='4aa67c03297c405fa4d5eb6510e3ba68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:43:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Creating volume 6ca3d885-7384-4824-a101-dfe1e0db0496 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:43:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:43:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:43:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:43:25 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:43:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6ca3d885-7384-4824-a101-dfe1e0db0496 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:25 devstack sudo[102378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6ca3d885-7384-4824-a101-dfe1e0db0496 1073741824 Nov 02 15:43:25 devstack sudo[102378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:26 devstack sudo[102378]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6ca3d885-7384-4824-a101-dfe1e0db0496 1073741824" returned: 0 in 0.537s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6ca3d885-7384-4824-a101-dfe1e0db0496 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:26 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6ca3d885-7384-4824-a101-dfe1e0db0496 Nov 02 15:43:26 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:26 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6ca3d885-7384-4824-a101-dfe1e0db0496" returned: 0 in 0.397s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:43:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e0694d7-4892-480f-9b3b-478be7eed3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ca3d885-7384-4824-a101-dfe1e0db0496', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (398bc550-08a4-48e8-b796-ed92b01088fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:26 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Volume volume-6ca3d885-7384-4824-a101-dfe1e0db0496 (6ca3d885-7384-4824-a101-dfe1e0db0496): created successfully Nov 02 15:43:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (398bc550-08a4-48e8-b796-ed92b01088fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Flow 'volume_create_manager' (9b478974-64ba-41e3-b398-c060d8660b45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:43:26 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-70972dad-7f50-4ffd-910b-bff51b1c19ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Created volume successfully. Nov 02 15:43:28 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:43:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Flow 'volume_create_manager' (825e6387-c9b6-495a-8f8e-8b11e16da2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:43:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58da1419-fd00-4506-b0b8-9aa1f793a36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58da1419-fd00-4506-b0b8-9aa1f793a36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1125782957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759ae8dc-5330-4e60-bef6-bb3ec2fb2f1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677f5ffbc0d04d7ea4645287cd07a4fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:43:28Z,use_quota=True,user_id='4aa67c03297c405fa4d5eb6510e3ba68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82527f9f-5923-4ece-abf0-bb7f1ca30f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82527f9f-5923-4ece-abf0-bb7f1ca30f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af834cc0-a128-4741-8ec6-6893a726789c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af834cc0-a128-4741-8ec6-6893a726789c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '759ae8dc-5330-4e60-bef6-bb3ec2fb2f1d', 'volume_name': 'volume-759ae8dc-5330-4e60-bef6-bb3ec2fb2f1d', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8faa118b-18fb-46e3-9616-b50a2fb168fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8faa118b-18fb-46e3-9616-b50a2fb168fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec27544-a5a7-4085-9766-e1e576c91c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:28 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Volume 759ae8dc-5330-4e60-bef6-bb3ec2fb2f1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-759ae8dc-5330-4e60-bef6-bb3ec2fb2f1d', 'volume_size': 1} Nov 02 15:43:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1125782957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=759ae8dc-5330-4e60-bef6-bb3ec2fb2f1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677f5ffbc0d04d7ea4645287cd07a4fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:43:28Z,use_quota=True,user_id='4aa67c03297c405fa4d5eb6510e3ba68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:43:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Creating volume 759ae8dc-5330-4e60-bef6-bb3ec2fb2f1d {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:43:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:43:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:43:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:43:28 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:43:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-759ae8dc-5330-4e60-bef6-bb3ec2fb2f1d 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:28 devstack sudo[102863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-759ae8dc-5330-4e60-bef6-bb3ec2fb2f1d 1073741824 Nov 02 15:43:28 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:29 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:43:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Flow 'volume_create_manager' (69c7f95f-6957-45da-a175-3bb72da39df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:43:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd14233a-2ac6-4dc2-821a-97dec047c077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd14233a-2ac6-4dc2-821a-97dec047c077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1143529291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d771ef9-b5ed-472a-ab4b-31bba8e5543b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677f5ffbc0d04d7ea4645287cd07a4fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:43:29Z,use_quota=True,user_id='4aa67c03297c405fa4d5eb6510e3ba68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f2f9a45-7862-492c-b886-e4581aba8c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f2f9a45-7862-492c-b886-e4581aba8c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (924880aa-8ecf-4529-b2bd-3cd35bc9d3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (924880aa-8ecf-4529-b2bd-3cd35bc9d3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d771ef9-b5ed-472a-ab4b-31bba8e5543b', 'volume_name': 'volume-5d771ef9-b5ed-472a-ab4b-31bba8e5543b', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7cfeaff-50be-440b-ae45-26e95784abe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7cfeaff-50be-440b-ae45-26e95784abe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3465807-440a-4212-bdb6-14d4d7fe4c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:29 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Volume 5d771ef9-b5ed-472a-ab4b-31bba8e5543b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d771ef9-b5ed-472a-ab4b-31bba8e5543b', 'volume_size': 1} Nov 02 15:43:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:29 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-759ae8dc-5330-4e60-bef6-bb3ec2fb2f1d 1073741824" returned: 0 in 0.777s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-759ae8dc-5330-4e60-bef6-bb3ec2fb2f1d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:29 devstack sudo[102870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-759ae8dc-5330-4e60-bef6-bb3ec2fb2f1d Nov 02 15:43:29 devstack sudo[102870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:29 devstack sudo[102870]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-759ae8dc-5330-4e60-bef6-bb3ec2fb2f1d" returned: 0 in 0.447s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:43:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.306s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.664s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1143529291',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d771ef9-b5ed-472a-ab4b-31bba8e5543b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677f5ffbc0d04d7ea4645287cd07a4fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:43:29Z,use_quota=True,user_id='4aa67c03297c405fa4d5eb6510e3ba68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:43:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Creating volume 5d771ef9-b5ed-472a-ab4b-31bba8e5543b {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:43:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:43:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:43:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:43:29 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:43:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5d771ef9-b5ed-472a-ab4b-31bba8e5543b 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec27544-a5a7-4085-9766-e1e576c91c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-759ae8dc-5330-4e60-bef6-bb3ec2fb2f1d', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:30 devstack sudo[102874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5d771ef9-b5ed-472a-ab4b-31bba8e5543b 1073741824 Nov 02 15:43:30 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7487bb27-94a7-4313-96d3-90ced1807f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:30 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Volume volume-759ae8dc-5330-4e60-bef6-bb3ec2fb2f1d (759ae8dc-5330-4e60-bef6-bb3ec2fb2f1d): created successfully Nov 02 15:43:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7487bb27-94a7-4313-96d3-90ced1807f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Flow 'volume_create_manager' (825e6387-c9b6-495a-8f8e-8b11e16da2b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:43:30 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-df0ad9cb-c2a2-4b70-907b-1875c1ebb673 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Created volume successfully. Nov 02 15:43:30 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:43:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Flow 'volume_create_manager' (70863417-0ec4-4b1c-83fa-c138d1a84510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:43:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29b09be9-c47e-4d83-ac2f-1f1a965bd30f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29b09be9-c47e-4d83-ac2f-1f1a965bd30f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1752484362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d6c2588-907a-4eed-98a2-6a4796c77ae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677f5ffbc0d04d7ea4645287cd07a4fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:43:30Z,use_quota=True,user_id='4aa67c03297c405fa4d5eb6510e3ba68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd3a591-0d66-48b2-a037-bade149e19b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd3a591-0d66-48b2-a037-bade149e19b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4142bf8-9ffe-4f66-9643-ddebf0192180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4142bf8-9ffe-4f66-9643-ddebf0192180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d6c2588-907a-4eed-98a2-6a4796c77ae8', 'volume_name': 'volume-6d6c2588-907a-4eed-98a2-6a4796c77ae8', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb16ea87-4a94-4d1a-bb0e-4000727b82b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb16ea87-4a94-4d1a-bb0e-4000727b82b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6679eac3-ef70-42eb-94bb-d7a20bb271a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:30 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Volume 6d6c2588-907a-4eed-98a2-6a4796c77ae8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d6c2588-907a-4eed-98a2-6a4796c77ae8', 'volume_size': 1} Nov 02 15:43:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:30 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:43:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Flow 'volume_create_manager' (9edeca24-16b2-4475-80c8-4a69bd525c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:43:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faaa8b2e-ba9b-4e1b-a67a-919f61018568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:30 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faaa8b2e-ba9b-4e1b-a67a-919f61018568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1952366166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63bd534a-9e8d-47c4-b6aa-72e554edda2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677f5ffbc0d04d7ea4645287cd07a4fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:43:31Z,use_quota=True,user_id='4aa67c03297c405fa4d5eb6510e3ba68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c5b063a-6b12-4aa3-aebb-a16eaee52c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c5b063a-6b12-4aa3-aebb-a16eaee52c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af4758a-72d7-4c82-ad76-cb2db5874ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5af4758a-72d7-4c82-ad76-cb2db5874ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63bd534a-9e8d-47c4-b6aa-72e554edda2e', 'volume_name': 'volume-63bd534a-9e8d-47c4-b6aa-72e554edda2e', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d4aba6-bc79-4d4f-a861-dfe01deb850b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d4aba6-bc79-4d4f-a861-dfe01deb850b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07c08a46-e130-4c59-9daf-a023471f9aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:30 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Volume 63bd534a-9e8d-47c4-b6aa-72e554edda2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63bd534a-9e8d-47c4-b6aa-72e554edda2e', 'volume_size': 1} Nov 02 15:43:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5d771ef9-b5ed-472a-ab4b-31bba8e5543b 1073741824" returned: 0 in 0.901s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5d771ef9-b5ed-472a-ab4b-31bba8e5543b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:30 devstack sudo[102880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5d771ef9-b5ed-472a-ab4b-31bba8e5543b Nov 02 15:43:30 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:31 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:43:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Flow 'volume_create_manager' (ec555052-2fd6-4ffe-a4f9-913d0bee21d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:43:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e69e3c20-1572-421b-81bb-93f0a0e6ea62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e69e3c20-1572-421b-81bb-93f0a0e6ea62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-857776872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2dbd33b-41ac-4497-a151-e73aeb5ffebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677f5ffbc0d04d7ea4645287cd07a4fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:43:31Z,use_quota=True,user_id='4aa67c03297c405fa4d5eb6510e3ba68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ace406-df3d-446e-9b1f-a444f4b646b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25ace406-df3d-446e-9b1f-a444f4b646b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (809e57e3-2ee6-42ca-84f8-4f462e427d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:31 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (809e57e3-2ee6-42ca-84f8-4f462e427d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2dbd33b-41ac-4497-a151-e73aeb5ffebc', 'volume_name': 'volume-c2dbd33b-41ac-4497-a151-e73aeb5ffebc', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adddf537-5951-46a8-94d1-8994b638ab1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adddf537-5951-46a8-94d1-8994b638ab1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (440e49b3-7c79-438a-89fa-0638de867d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:31 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Volume c2dbd33b-41ac-4497-a151-e73aeb5ffebc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2dbd33b-41ac-4497-a151-e73aeb5ffebc', 'volume_size': 1} Nov 02 15:43:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5d771ef9-b5ed-472a-ab4b-31bba8e5543b" returned: 0 in 0.676s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:43:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.217s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1752484362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d6c2588-907a-4eed-98a2-6a4796c77ae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677f5ffbc0d04d7ea4645287cd07a4fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:43:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:43:30Z,use_quota=True,user_id='4aa67c03297c405fa4d5eb6510e3ba68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:43:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Creating volume 6d6c2588-907a-4eed-98a2-6a4796c77ae8 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:43:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:43:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:43:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:43:31 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:43:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6d6c2588-907a-4eed-98a2-6a4796c77ae8 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:31 devstack sudo[102883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6d6c2588-907a-4eed-98a2-6a4796c77ae8 1073741824 Nov 02 15:43:31 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3465807-440a-4212-bdb6-14d4d7fe4c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d771ef9-b5ed-472a-ab4b-31bba8e5543b', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59ab5b9-0a6b-4c57-860f-8e8b321f920f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:31 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Volume volume-5d771ef9-b5ed-472a-ab4b-31bba8e5543b (5d771ef9-b5ed-472a-ab4b-31bba8e5543b): created successfully Nov 02 15:43:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59ab5b9-0a6b-4c57-860f-8e8b321f920f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Flow 'volume_create_manager' (69c7f95f-6957-45da-a175-3bb72da39df1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:43:31 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-f3ead076-478d-42a2-b892-2a704a0264ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Created volume successfully. Nov 02 15:43:32 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6d6c2588-907a-4eed-98a2-6a4796c77ae8 1073741824" returned: 0 in 0.684s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6d6c2588-907a-4eed-98a2-6a4796c77ae8 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:32 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6d6c2588-907a-4eed-98a2-6a4796c77ae8 Nov 02 15:43:32 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:32 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6d6c2588-907a-4eed-98a2-6a4796c77ae8" returned: 0 in 0.444s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:43:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.981s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1952366166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63bd534a-9e8d-47c4-b6aa-72e554edda2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677f5ffbc0d04d7ea4645287cd07a4fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:43:31Z,use_quota=True,user_id='4aa67c03297c405fa4d5eb6510e3ba68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:43:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Creating volume 63bd534a-9e8d-47c4-b6aa-72e554edda2e {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:43:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:43:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:43:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:43:32 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:43:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-63bd534a-9e8d-47c4-b6aa-72e554edda2e 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:32 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-63bd534a-9e8d-47c4-b6aa-72e554edda2e 1073741824 Nov 02 15:43:32 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6679eac3-ef70-42eb-94bb-d7a20bb271a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d6c2588-907a-4eed-98a2-6a4796c77ae8', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c7d0dfd-35a4-4467-a303-993f348797d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:32 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Volume volume-6d6c2588-907a-4eed-98a2-6a4796c77ae8 (6d6c2588-907a-4eed-98a2-6a4796c77ae8): created successfully Nov 02 15:43:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c7d0dfd-35a4-4467-a303-993f348797d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Flow 'volume_create_manager' (70863417-0ec4-4b1c-83fa-c138d1a84510) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:43:33 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-0f93d27e-3f41-49b2-8f16-acc93bace5ca tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Created volume successfully. Nov 02 15:43:33 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-63bd534a-9e8d-47c4-b6aa-72e554edda2e 1073741824" returned: 0 in 0.757s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-63bd534a-9e8d-47c4-b6aa-72e554edda2e {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:33 devstack sudo[102898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-63bd534a-9e8d-47c4-b6aa-72e554edda2e Nov 02 15:43:33 devstack sudo[102898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:34 devstack sudo[102898]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-63bd534a-9e8d-47c4-b6aa-72e554edda2e" returned: 0 in 0.369s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:34 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:43:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.501s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:34 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:43:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-857776872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2dbd33b-41ac-4497-a151-e73aeb5ffebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='677f5ffbc0d04d7ea4645287cd07a4fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:43:31Z,use_quota=True,user_id='4aa67c03297c405fa4d5eb6510e3ba68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:43:34 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Creating volume c2dbd33b-41ac-4497-a151-e73aeb5ffebc {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:43:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:34 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:43:34 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:43:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:34 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:43:34 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:43:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c2dbd33b-41ac-4497-a151-e73aeb5ffebc 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:34 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07c08a46-e130-4c59-9daf-a023471f9aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63bd534a-9e8d-47c4-b6aa-72e554edda2e', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:34 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e1dd505-afb8-4d25-ba2a-d60f64d5736c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:34 devstack sudo[102901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c2dbd33b-41ac-4497-a151-e73aeb5ffebc 1073741824 Nov 02 15:43:34 devstack sudo[102901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:34 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Volume volume-63bd534a-9e8d-47c4-b6aa-72e554edda2e (63bd534a-9e8d-47c4-b6aa-72e554edda2e): created successfully Nov 02 15:43:34 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e1dd505-afb8-4d25-ba2a-d60f64d5736c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:34 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Flow 'volume_create_manager' (9edeca24-16b2-4475-80c8-4a69bd525c6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:43:34 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-64a65a68-f120-4ab0-8cae-da1644ea03df tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Created volume successfully. Nov 02 15:43:34 devstack sudo[102901]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c2dbd33b-41ac-4497-a151-e73aeb5ffebc 1073741824" returned: 0 in 0.736s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c2dbd33b-41ac-4497-a151-e73aeb5ffebc {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:34 devstack sudo[102907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c2dbd33b-41ac-4497-a151-e73aeb5ffebc Nov 02 15:43:34 devstack sudo[102907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:35 devstack sudo[102907]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c2dbd33b-41ac-4497-a151-e73aeb5ffebc" returned: 0 in 0.557s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:35 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] <== create_volume: return (1382ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:43:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:35 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (440e49b3-7c79-438a-89fa-0638de867d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2dbd33b-41ac-4497-a151-e73aeb5ffebc', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:35 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd31718-f51a-40dd-ad0a-d7948df04e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:35 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Volume volume-c2dbd33b-41ac-4497-a151-e73aeb5ffebc (c2dbd33b-41ac-4497-a151-e73aeb5ffebc): created successfully Nov 02 15:43:35 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd31718-f51a-40dd-ad0a-d7948df04e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:35 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Flow 'volume_create_manager' (ec555052-2fd6-4ffe-a4f9-913d0bee21d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:43:35 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-75bbe1cd-0f9c-4f95-ae6c-17d91abcf95d tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Created volume successfully. Nov 02 15:43:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8611fbfd-a3b0-4d3a-bba4-d8e4e87253cc tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Acquiring lock "cinder-c2dbd33b-41ac-4497-a151-e73aeb5ffebc-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8611fbfd-a3b0-4d3a-bba4-d8e4e87253cc tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "cinder-c2dbd33b-41ac-4497-a151-e73aeb5ffebc-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8611fbfd-a3b0-4d3a-bba4-d8e4e87253cc tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Acquiring lock "cinder-quobyte-c2dbd33b-41ac-4497-a151-e73aeb5ffebc" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8611fbfd-a3b0-4d3a-bba4-d8e4e87253cc tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "cinder-quobyte-c2dbd33b-41ac-4497-a151-e73aeb5ffebc" acquired by "delete_volume" :: waited 0.026s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:36 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5431a7-fe60-4a0d-82b5-4281ebb65a36]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:43:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8611fbfd-a3b0-4d3a-bba4-d8e4e87253cc tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c2dbd33b-41ac-4497-a151-e73aeb5ffebc {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:36 devstack sudo[102912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c2dbd33b-41ac-4497-a151-e73aeb5ffebc Nov 02 15:43:36 devstack sudo[102912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:37 devstack sudo[102912]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8611fbfd-a3b0-4d3a-bba4-d8e4e87253cc tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c2dbd33b-41ac-4497-a151-e73aeb5ffebc" returned: 0 in 0.500s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8611fbfd-a3b0-4d3a-bba4-d8e4e87253cc tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c2dbd33b-41ac-4497-a151-e73aeb5ffebc {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:37 devstack sudo[102917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c2dbd33b-41ac-4497-a151-e73aeb5ffebc Nov 02 15:43:37 devstack sudo[102917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:37 devstack sudo[102917]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8611fbfd-a3b0-4d3a-bba4-d8e4e87253cc tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c2dbd33b-41ac-4497-a151-e73aeb5ffebc" returned: 0 in 0.310s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:37 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8611fbfd-a3b0-4d3a-bba4-d8e4e87253cc tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "cinder-quobyte-c2dbd33b-41ac-4497-a151-e73aeb5ffebc" released by "delete_volume" :: held 0.891s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:43:37 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-8611fbfd-a3b0-4d3a-bba4-d8e4e87253cc tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Created reservations ['ba43d6e6-e7f5-4fd1-81fa-e5d0e4e6d9a2', '06546b53-f13e-4dc1-80a5-f0417ffc038d', 'd221286d-1452-4567-ac31-34c7717b707d', '5b53fe4c-372a-4ffe-9242-981757111fb4'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:43:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8611fbfd-a3b0-4d3a-bba4-d8e4e87253cc tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8611fbfd-a3b0-4d3a-bba4-d8e4e87253cc tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8611fbfd-a3b0-4d3a-bba4-d8e4e87253cc tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:43:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8611fbfd-a3b0-4d3a-bba4-d8e4e87253cc tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:43:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8611fbfd-a3b0-4d3a-bba4-d8e4e87253cc tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8611fbfd-a3b0-4d3a-bba4-d8e4e87253cc tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:37 devstack sudo[102921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:43:37 devstack sudo[102921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:37 devstack sudo[102921]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8611fbfd-a3b0-4d3a-bba4-d8e4e87253cc tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.294s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:37 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-8611fbfd-a3b0-4d3a-bba4-d8e4e87253cc tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:43:38 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-8611fbfd-a3b0-4d3a-bba4-d8e4e87253cc tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Deleted volume successfully. Nov 02 15:43:38 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8611fbfd-a3b0-4d3a-bba4-d8e4e87253cc tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "cinder-c2dbd33b-41ac-4497-a151-e73aeb5ffebc-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:43:38 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-cb080d07-4db5-44ac-b6e3-5c4aa44b75b4 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Acquiring lock "cinder-63bd534a-9e8d-47c4-b6aa-72e554edda2e-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:38 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-cb080d07-4db5-44ac-b6e3-5c4aa44b75b4 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "cinder-63bd534a-9e8d-47c4-b6aa-72e554edda2e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:38 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-cb080d07-4db5-44ac-b6e3-5c4aa44b75b4 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Acquiring lock "cinder-quobyte-63bd534a-9e8d-47c4-b6aa-72e554edda2e" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:38 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-cb080d07-4db5-44ac-b6e3-5c4aa44b75b4 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "cinder-quobyte-63bd534a-9e8d-47c4-b6aa-72e554edda2e" acquired by "delete_volume" :: waited 0.015s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:38 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5859ff-f1e2-49c0-8f86-f762aaf12af3]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:43:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cb080d07-4db5-44ac-b6e3-5c4aa44b75b4 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-63bd534a-9e8d-47c4-b6aa-72e554edda2e {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:39 devstack sudo[102924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-63bd534a-9e8d-47c4-b6aa-72e554edda2e Nov 02 15:43:39 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:39 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cb080d07-4db5-44ac-b6e3-5c4aa44b75b4 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-63bd534a-9e8d-47c4-b6aa-72e554edda2e" returned: 0 in 0.453s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cb080d07-4db5-44ac-b6e3-5c4aa44b75b4 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-63bd534a-9e8d-47c4-b6aa-72e554edda2e {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:39 devstack sudo[102929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-63bd534a-9e8d-47c4-b6aa-72e554edda2e Nov 02 15:43:39 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:39 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cb080d07-4db5-44ac-b6e3-5c4aa44b75b4 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-63bd534a-9e8d-47c4-b6aa-72e554edda2e" returned: 0 in 0.328s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-cb080d07-4db5-44ac-b6e3-5c4aa44b75b4 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "cinder-quobyte-63bd534a-9e8d-47c4-b6aa-72e554edda2e" released by "delete_volume" :: held 0.831s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:43:39 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-cb080d07-4db5-44ac-b6e3-5c4aa44b75b4 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Created reservations ['3ec4d013-07a0-4e23-8040-1ede4c5c2dc7', '9c2e1dab-816c-4ed3-8e1f-11b343b0670d', 'c78f6f0f-4750-4c13-860d-a841e4fc9cf7', 'f7329af4-79f6-4ef4-acc6-c3a347bb548e'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:43:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-cb080d07-4db5-44ac-b6e3-5c4aa44b75b4 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-cb080d07-4db5-44ac-b6e3-5c4aa44b75b4 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:39 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-cb080d07-4db5-44ac-b6e3-5c4aa44b75b4 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:43:39 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-cb080d07-4db5-44ac-b6e3-5c4aa44b75b4 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:43:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-cb080d07-4db5-44ac-b6e3-5c4aa44b75b4 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cb080d07-4db5-44ac-b6e3-5c4aa44b75b4 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:40 devstack sudo[102932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:43:40 devstack sudo[102932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-87cc874c-1f68-434c-be12-01d756789770 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Acquiring lock "cinder-6d6c2588-907a-4eed-98a2-6a4796c77ae8-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-87cc874c-1f68-434c-be12-01d756789770 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "cinder-6d6c2588-907a-4eed-98a2-6a4796c77ae8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-87cc874c-1f68-434c-be12-01d756789770 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Acquiring lock "cinder-quobyte-6d6c2588-907a-4eed-98a2-6a4796c77ae8" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-87cc874c-1f68-434c-be12-01d756789770 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "cinder-quobyte-6d6c2588-907a-4eed-98a2-6a4796c77ae8" acquired by "delete_volume" :: waited 0.022s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:40 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d137e2a-ad03-4fc8-99ba-3659cbdd38ca]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:43:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-87cc874c-1f68-434c-be12-01d756789770 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6d6c2588-907a-4eed-98a2-6a4796c77ae8 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:40 devstack sudo[102932]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:40 devstack sudo[102934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6d6c2588-907a-4eed-98a2-6a4796c77ae8 Nov 02 15:43:40 devstack sudo[102934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cb080d07-4db5-44ac-b6e3-5c4aa44b75b4 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.439s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:40 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-cb080d07-4db5-44ac-b6e3-5c4aa44b75b4 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:43:40 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-cb080d07-4db5-44ac-b6e3-5c4aa44b75b4 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Deleted volume successfully. Nov 02 15:43:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-cb080d07-4db5-44ac-b6e3-5c4aa44b75b4 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "cinder-63bd534a-9e8d-47c4-b6aa-72e554edda2e-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:43:40 devstack sudo[102934]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-87cc874c-1f68-434c-be12-01d756789770 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6d6c2588-907a-4eed-98a2-6a4796c77ae8" returned: 0 in 0.494s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-87cc874c-1f68-434c-be12-01d756789770 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6d6c2588-907a-4eed-98a2-6a4796c77ae8 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:40 devstack sudo[102941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6d6c2588-907a-4eed-98a2-6a4796c77ae8 Nov 02 15:43:40 devstack sudo[102941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:41 devstack sudo[102941]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-87cc874c-1f68-434c-be12-01d756789770 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6d6c2588-907a-4eed-98a2-6a4796c77ae8" returned: 0 in 0.307s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:41 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-87cc874c-1f68-434c-be12-01d756789770 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "cinder-quobyte-6d6c2588-907a-4eed-98a2-6a4796c77ae8" released by "delete_volume" :: held 0.892s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:43:41 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-87cc874c-1f68-434c-be12-01d756789770 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Created reservations ['bc1864ae-bb19-439b-a80c-bf444a3ef6f9', 'faa18ae2-6b1e-467d-9d30-ab6534e3352d', '75e56ef2-0f61-424c-9bd5-1ec8f5474c41', 'a78c0c44-9a73-4b2e-8b7c-ccdc49691b88'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:43:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-87cc874c-1f68-434c-be12-01d756789770 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-87cc874c-1f68-434c-be12-01d756789770 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:41 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-87cc874c-1f68-434c-be12-01d756789770 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:43:41 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-87cc874c-1f68-434c-be12-01d756789770 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:43:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-87cc874c-1f68-434c-be12-01d756789770 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-87cc874c-1f68-434c-be12-01d756789770 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:41 devstack sudo[102944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:43:41 devstack sudo[102944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:41 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-859c4d65-7e2d-40fc-8359-12709372be00 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Acquiring lock "cinder-5d771ef9-b5ed-472a-ab4b-31bba8e5543b-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:41 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-859c4d65-7e2d-40fc-8359-12709372be00 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "cinder-5d771ef9-b5ed-472a-ab4b-31bba8e5543b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:41 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-859c4d65-7e2d-40fc-8359-12709372be00 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Acquiring lock "cinder-quobyte-5d771ef9-b5ed-472a-ab4b-31bba8e5543b" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:41 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-859c4d65-7e2d-40fc-8359-12709372be00 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "cinder-quobyte-5d771ef9-b5ed-472a-ab4b-31bba8e5543b" acquired by "delete_volume" :: waited 0.040s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:41 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[616d7f6e-6937-41ae-8bf3-9226859444f0]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:43:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-859c4d65-7e2d-40fc-8359-12709372be00 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5d771ef9-b5ed-472a-ab4b-31bba8e5543b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:41 devstack sudo[102944]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-87cc874c-1f68-434c-be12-01d756789770 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.471s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:41 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-87cc874c-1f68-434c-be12-01d756789770 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:43:41 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-87cc874c-1f68-434c-be12-01d756789770 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Deleted volume successfully. Nov 02 15:43:41 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-87cc874c-1f68-434c-be12-01d756789770 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "cinder-6d6c2588-907a-4eed-98a2-6a4796c77ae8-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:43:41 devstack sudo[102946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5d771ef9-b5ed-472a-ab4b-31bba8e5543b Nov 02 15:43:41 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:42 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-859c4d65-7e2d-40fc-8359-12709372be00 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5d771ef9-b5ed-472a-ab4b-31bba8e5543b" returned: 0 in 0.578s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-859c4d65-7e2d-40fc-8359-12709372be00 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5d771ef9-b5ed-472a-ab4b-31bba8e5543b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:42 devstack sudo[102952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5d771ef9-b5ed-472a-ab4b-31bba8e5543b Nov 02 15:43:42 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:42 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-859c4d65-7e2d-40fc-8359-12709372be00 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5d771ef9-b5ed-472a-ab4b-31bba8e5543b" returned: 0 in 0.288s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:42 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-859c4d65-7e2d-40fc-8359-12709372be00 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "cinder-quobyte-5d771ef9-b5ed-472a-ab4b-31bba8e5543b" released by "delete_volume" :: held 0.933s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:43:42 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-859c4d65-7e2d-40fc-8359-12709372be00 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Created reservations ['ae0d563f-4d11-47c4-af36-4f00320ca350', '7be179dd-e813-4303-9208-242b41b71ed5', 'ea936317-199d-4133-a7e4-318346ed4f7f', '1e08893d-59c7-4072-8264-ecbe128c75dc'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:43:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-859c4d65-7e2d-40fc-8359-12709372be00 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-859c4d65-7e2d-40fc-8359-12709372be00 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:42 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-859c4d65-7e2d-40fc-8359-12709372be00 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:43:42 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-859c4d65-7e2d-40fc-8359-12709372be00 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:43:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-859c4d65-7e2d-40fc-8359-12709372be00 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-859c4d65-7e2d-40fc-8359-12709372be00 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:42 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:43:42 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:42 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-859c4d65-7e2d-40fc-8359-12709372be00 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.304s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:42 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-859c4d65-7e2d-40fc-8359-12709372be00 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:43:42 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-859c4d65-7e2d-40fc-8359-12709372be00 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Deleted volume successfully. Nov 02 15:43:43 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-859c4d65-7e2d-40fc-8359-12709372be00 tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "cinder-5d771ef9-b5ed-472a-ab4b-31bba8e5543b-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:43:43 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:43:43 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] Flow 'volume_create_manager' (4b7c7831-ba3e-4df6-ad7a-9fd93d37a5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:43:43 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69b270fd-1838-49fc-9e95-b73214cc089d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:43 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69b270fd-1838-49fc-9e95-b73214cc089d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1529326257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b77273a0-b4bb-4d28-a576-f2393f97e238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='551fd347ecd44eb99c9a6d34709b8339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:43:43Z,use_quota=True,user_id='c3572d47d42942828dbbe784882a32bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:43 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aec1e64-5fb2-4dfb-9c1c-a7c210d4fa64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:43 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aec1e64-5fb2-4dfb-9c1c-a7c210d4fa64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:43 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc7f7a59-70e8-4ddc-a770-570a5a6eb6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:43 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc7f7a59-70e8-4ddc-a770-570a5a6eb6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b77273a0-b4bb-4d28-a576-f2393f97e238', 'volume_name': 'volume-b77273a0-b4bb-4d28-a576-f2393f97e238', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:43 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e13d65-8b53-41ac-bfe8-3b958ac8af2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:43 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e13d65-8b53-41ac-bfe8-3b958ac8af2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:43 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37bf0b73-f33c-4f45-b961-a2897c8cfc96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:43 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] Volume b77273a0-b4bb-4d28-a576-f2393f97e238: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b77273a0-b4bb-4d28-a576-f2393f97e238', 'volume_size': 1} Nov 02 15:43:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:43:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1529326257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b77273a0-b4bb-4d28-a576-f2393f97e238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='551fd347ecd44eb99c9a6d34709b8339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:43:43Z,use_quota=True,user_id='c3572d47d42942828dbbe784882a32bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:43:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] Creating volume b77273a0-b4bb-4d28-a576-f2393f97e238 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:43:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:43:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:43:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:43:43 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:43:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:43 devstack sudo[102959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238 1073741824 Nov 02 15:43:43 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:43 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ef1140a3-f83e-4993-9fed-c368798fb41c tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Acquiring lock "cinder-759ae8dc-5330-4e60-bef6-bb3ec2fb2f1d-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:43 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ef1140a3-f83e-4993-9fed-c368798fb41c tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "cinder-759ae8dc-5330-4e60-bef6-bb3ec2fb2f1d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:43 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ef1140a3-f83e-4993-9fed-c368798fb41c tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Acquiring lock "cinder-quobyte-759ae8dc-5330-4e60-bef6-bb3ec2fb2f1d" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:43 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ef1140a3-f83e-4993-9fed-c368798fb41c tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "cinder-quobyte-759ae8dc-5330-4e60-bef6-bb3ec2fb2f1d" acquired by "delete_volume" :: waited 0.019s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:43 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b0cd7b-0c9a-41a4-af86-46bcfc4d5040]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:43:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ef1140a3-f83e-4993-9fed-c368798fb41c tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-759ae8dc-5330-4e60-bef6-bb3ec2fb2f1d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:43 devstack sudo[102961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-759ae8dc-5330-4e60-bef6-bb3ec2fb2f1d Nov 02 15:43:43 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:44 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238 1073741824" returned: 0 in 0.506s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:44 devstack sudo[102967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238 Nov 02 15:43:44 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:44 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ef1140a3-f83e-4993-9fed-c368798fb41c tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-759ae8dc-5330-4e60-bef6-bb3ec2fb2f1d" returned: 0 in 0.434s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ef1140a3-f83e-4993-9fed-c368798fb41c tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-759ae8dc-5330-4e60-bef6-bb3ec2fb2f1d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:44 devstack sudo[102973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-759ae8dc-5330-4e60-bef6-bb3ec2fb2f1d Nov 02 15:43:44 devstack sudo[102973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:44 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238" returned: 0 in 0.291s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:44 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:43:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37bf0b73-f33c-4f45-b961-a2897c8cfc96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b77273a0-b4bb-4d28-a576-f2393f97e238', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (859341a3-ad3a-4543-b4f5-3b3816fed7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:44 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] Volume volume-b77273a0-b4bb-4d28-a576-f2393f97e238 (b77273a0-b4bb-4d28-a576-f2393f97e238): created successfully Nov 02 15:43:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (859341a3-ad3a-4543-b4f5-3b3816fed7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] Flow 'volume_create_manager' (4b7c7831-ba3e-4df6-ad7a-9fd93d37a5d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:43:44 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-47829e3c-8fcb-4d1e-9e7c-531e2173d5c4 tempest-VolumesSnapshotTestJSON-1655319342 None] Created volume successfully. Nov 02 15:43:44 devstack sudo[102973]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ef1140a3-f83e-4993-9fed-c368798fb41c tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-759ae8dc-5330-4e60-bef6-bb3ec2fb2f1d" returned: 0 in 0.299s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:44 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ef1140a3-f83e-4993-9fed-c368798fb41c tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "cinder-quobyte-759ae8dc-5330-4e60-bef6-bb3ec2fb2f1d" released by "delete_volume" :: held 0.786s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:43:44 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-ef1140a3-f83e-4993-9fed-c368798fb41c tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Created reservations ['33f1e3fc-52e4-4d0a-9228-56b8b44f3283', 'bd46a0d9-618b-472d-80f6-ec27ef267dd5', '4123e83e-a1e1-40e2-a016-668b6fc2b8b7', '46822ae0-3b9e-46b2-bd7c-a947000a7bb8'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:43:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ef1140a3-f83e-4993-9fed-c368798fb41c tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ef1140a3-f83e-4993-9fed-c368798fb41c tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:44 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ef1140a3-f83e-4993-9fed-c368798fb41c tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:43:44 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ef1140a3-f83e-4993-9fed-c368798fb41c tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:43:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ef1140a3-f83e-4993-9fed-c368798fb41c tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ef1140a3-f83e-4993-9fed-c368798fb41c tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:44 devstack sudo[102977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:43:44 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:44 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-581a0926-5246-4151-b47f-ad3e32633ade tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Acquiring lock "cinder-6ca3d885-7384-4824-a101-dfe1e0db0496-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:44 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-581a0926-5246-4151-b47f-ad3e32633ade tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "cinder-6ca3d885-7384-4824-a101-dfe1e0db0496-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:44 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ef1140a3-f83e-4993-9fed-c368798fb41c tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.273s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:44 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-ef1140a3-f83e-4993-9fed-c368798fb41c tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:43:44 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-ef1140a3-f83e-4993-9fed-c368798fb41c tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Deleted volume successfully. Nov 02 15:43:44 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-581a0926-5246-4151-b47f-ad3e32633ade tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Acquiring lock "cinder-quobyte-6ca3d885-7384-4824-a101-dfe1e0db0496" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-581a0926-5246-4151-b47f-ad3e32633ade tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "cinder-quobyte-6ca3d885-7384-4824-a101-dfe1e0db0496" acquired by "delete_volume" :: waited 0.018s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ef1140a3-f83e-4993-9fed-c368798fb41c tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "cinder-759ae8dc-5330-4e60-bef6-bb3ec2fb2f1d-delete_volume" released by "delete_volume" :: held 1.300s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:43:45 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef818a67-148a-4fc8-beed-b1931e8b8cad]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:43:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-581a0926-5246-4151-b47f-ad3e32633ade tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6ca3d885-7384-4824-a101-dfe1e0db0496 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:45 devstack sudo[102980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6ca3d885-7384-4824-a101-dfe1e0db0496 Nov 02 15:43:45 devstack sudo[102980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:45 devstack sudo[102980]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-581a0926-5246-4151-b47f-ad3e32633ade tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6ca3d885-7384-4824-a101-dfe1e0db0496" returned: 0 in 0.374s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-581a0926-5246-4151-b47f-ad3e32633ade tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6ca3d885-7384-4824-a101-dfe1e0db0496 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:45 devstack sudo[102985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6ca3d885-7384-4824-a101-dfe1e0db0496 Nov 02 15:43:45 devstack sudo[102985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:45 devstack sudo[102985]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-581a0926-5246-4151-b47f-ad3e32633ade tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6ca3d885-7384-4824-a101-dfe1e0db0496" returned: 0 in 0.311s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-581a0926-5246-4151-b47f-ad3e32633ade tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "cinder-quobyte-6ca3d885-7384-4824-a101-dfe1e0db0496" released by "delete_volume" :: held 0.748s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:43:45 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-581a0926-5246-4151-b47f-ad3e32633ade tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Created reservations ['9c723b66-4fff-483d-931d-fb36525af518', 'f2683c4a-4e7d-493c-811f-e317f5d95c57', 'ab5ec5ea-6203-4800-a715-26eb39108531', '0893f9cd-3247-498c-afa0-25dab3120a45'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:43:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-581a0926-5246-4151-b47f-ad3e32633ade tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-581a0926-5246-4151-b47f-ad3e32633ade tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:45 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-581a0926-5246-4151-b47f-ad3e32633ade tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:43:45 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-581a0926-5246-4151-b47f-ad3e32633ade tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:43:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-581a0926-5246-4151-b47f-ad3e32633ade tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-581a0926-5246-4151-b47f-ad3e32633ade tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:45 devstack sudo[102993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:43:45 devstack sudo[102993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f7f39cd9-fa21-4871-98e0-c75797dd9759 tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f7f39cd9-fa21-4871-98e0-c75797dd9759 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:46 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-f7f39cd9-fa21-4871-98e0-c75797dd9759 tempest-VolumesSnapshotTestJSON-1655319342 None] Creating offline snapshot afbcbdf9-815b-4d34-bb23-db8d62f28423 of volume b77273a0-b4bb-4d28-a576-f2393f97e238 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:43:46 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2822b1d2-4482-410b-b7fb-b83e6a87d089]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:43:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f7f39cd9-fa21-4871-98e0-c75797dd9759 tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:46 devstack sudo[102995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238 Nov 02 15:43:46 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:46 devstack sudo[102993]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-581a0926-5246-4151-b47f-ad3e32633ade tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.292s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:46 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-581a0926-5246-4151-b47f-ad3e32633ade tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:43:46 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-581a0926-5246-4151-b47f-ad3e32633ade tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Deleted volume successfully. Nov 02 15:43:46 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-581a0926-5246-4151-b47f-ad3e32633ade tempest-CreateVolumesFromSourceVolumeTest-1254776412 None] Lock "cinder-6ca3d885-7384-4824-a101-dfe1e0db0496-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:43:46 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f7f39cd9-fa21-4871-98e0-c75797dd9759 tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238" returned: 0 in 0.517s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f7f39cd9-fa21-4871-98e0-c75797dd9759 tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238.afbcbdf9-815b-4d34-bb23-db8d62f28423 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:46 devstack sudo[103003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238.afbcbdf9-815b-4d34-bb23-db8d62f28423 1G Nov 02 15:43:46 devstack sudo[103003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:47 devstack sudo[103003]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f7f39cd9-fa21-4871-98e0-c75797dd9759 tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238.afbcbdf9-815b-4d34-bb23-db8d62f28423 1G" returned: 0 in 0.609s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f7f39cd9-fa21-4871-98e0-c75797dd9759 tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b77273a0-b4bb-4d28-a576-f2393f97e238 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238.afbcbdf9-815b-4d34-bb23-db8d62f28423 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:47 devstack sudo[103009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b77273a0-b4bb-4d28-a576-f2393f97e238 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238.afbcbdf9-815b-4d34-bb23-db8d62f28423 Nov 02 15:43:47 devstack sudo[103009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:47 devstack sudo[103009]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f7f39cd9-fa21-4871-98e0-c75797dd9759 tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b77273a0-b4bb-4d28-a576-f2393f97e238 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238.afbcbdf9-815b-4d34-bb23-db8d62f28423" returned: 0 in 0.386s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:47 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-f7f39cd9-fa21-4871-98e0-c75797dd9759 tempest-VolumesSnapshotTestJSON-1655319342 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238.afbcbdf9-815b-4d34-bb23-db8d62f28423 is being set with open permissions: ugo+rw Nov 02 15:43:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f7f39cd9-fa21-4871-98e0-c75797dd9759 tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238.afbcbdf9-815b-4d34-bb23-db8d62f28423 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:47 devstack sudo[103051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238.afbcbdf9-815b-4d34-bb23-db8d62f28423 Nov 02 15:43:47 devstack sudo[103051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:47 devstack sudo[103051]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f7f39cd9-fa21-4871-98e0-c75797dd9759 tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238.afbcbdf9-815b-4d34-bb23-db8d62f28423" returned: 0 in 0.309s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f7f39cd9-fa21-4871-98e0-c75797dd9759 tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:47 devstack sudo[103054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238.info Nov 02 15:43:47 devstack sudo[103054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:48 devstack sudo[103054]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f7f39cd9-fa21-4871-98e0-c75797dd9759 tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238.info" returned: 0 in 0.275s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:48 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-f7f39cd9-fa21-4871-98e0-c75797dd9759 tempest-VolumesSnapshotTestJSON-1655319342 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238.info is being set with open permissions: ugo+rw Nov 02 15:43:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f7f39cd9-fa21-4871-98e0-c75797dd9759 tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:48 devstack sudo[103057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238.info Nov 02 15:43:48 devstack sudo[103057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:48 devstack sudo[103057]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f7f39cd9-fa21-4871-98e0-c75797dd9759 tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238.info" returned: 0 in 0.251s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f7f39cd9-fa21-4871-98e0-c75797dd9759 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.470s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:48 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-f7f39cd9-fa21-4871-98e0-c75797dd9759 tempest-VolumesSnapshotTestJSON-1655319342 None] Create snapshot completed successfully Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3a96be00-c025-46fd-913d-5dd2ffa3371e tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "cinder-afbcbdf9-815b-4d34-bb23-db8d62f28423-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3a96be00-c025-46fd-913d-5dd2ffa3371e tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-afbcbdf9-815b-4d34-bb23-db8d62f28423-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3a96be00-c025-46fd-913d-5dd2ffa3371e tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "cinder-quobyte-b77273a0-b4bb-4d28-a576-f2393f97e238" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3a96be00-c025-46fd-913d-5dd2ffa3371e tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-quobyte-b77273a0-b4bb-4d28-a576-f2393f97e238" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3a96be00-c025-46fd-913d-5dd2ffa3371e tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "cinder-quobyte-afbcbdf9-815b-4d34-bb23-db8d62f28423" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3a96be00-c025-46fd-913d-5dd2ffa3371e tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-quobyte-afbcbdf9-815b-4d34-bb23-db8d62f28423" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-3a96be00-c025-46fd-913d-5dd2ffa3371e tempest-VolumesSnapshotTestJSON-1655319342 None] Deleting offline snapshot afbcbdf9-815b-4d34-bb23-db8d62f28423 of volume b77273a0-b4bb-4d28-a576-f2393f97e238 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-3a96be00-c025-46fd-913d-5dd2ffa3371e tempest-VolumesSnapshotTestJSON-1655319342 None] snapshot_file for this snap is: volume-b77273a0-b4bb-4d28-a576-f2393f97e238.afbcbdf9-815b-4d34-bb23-db8d62f28423 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b05d235-f847-42fd-8ca0-1b3e9b12d4dc]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3a96be00-c025-46fd-913d-5dd2ffa3371e tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238.afbcbdf9-815b-4d34-bb23-db8d62f28423 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] Flow 'volume_create_manager' (c5aba76c-294e-44a4-a0c6-49ba2214eab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6806cbc-1a1d-4c9c-b31b-49832f1481d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6806cbc-1a1d-4c9c-b31b-49832f1481d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1844313497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ee64c4f-67fd-424e-af40-36e767d34d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e04375bac2a34c22b9e6c782af80713e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:43:49Z,use_quota=True,user_id='50483d50a0944d75949fbca8eecb30c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b654715-f5f8-4585-adf6-a2a1800ffbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b654715-f5f8-4585-adf6-a2a1800ffbfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1288491-02f9-4306-abbb-32ae51b5de99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1288491-02f9-4306-abbb-32ae51b5de99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ee64c4f-67fd-424e-af40-36e767d34d77', 'volume_name': 'volume-1ee64c4f-67fd-424e-af40-36e767d34d77', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9978f060-2308-4882-9460-f21ba2575ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9978f060-2308-4882-9460-f21ba2575ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4346088-fec3-451e-b0a0-755260d9078c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:49 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] Volume 1ee64c4f-67fd-424e-af40-36e767d34d77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ee64c4f-67fd-424e-af40-36e767d34d77', 'volume_size': 1} Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:43:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1844313497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ee64c4f-67fd-424e-af40-36e767d34d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e04375bac2a34c22b9e6c782af80713e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:43:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:43:49Z,use_quota=True,user_id='50483d50a0944d75949fbca8eecb30c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] Creating volume 1ee64c4f-67fd-424e-af40-36e767d34d77 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:43:49 devstack sudo[103060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238.afbcbdf9-815b-4d34-bb23-db8d62f28423 Nov 02 15:43:49 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:43:49 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:49 devstack sudo[103062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77 1073741824 Nov 02 15:43:49 devstack sudo[103062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:49 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3a96be00-c025-46fd-913d-5dd2ffa3371e tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238.afbcbdf9-815b-4d34-bb23-db8d62f28423" returned: 0 in 0.408s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-3a96be00-c025-46fd-913d-5dd2ffa3371e tempest-VolumesSnapshotTestJSON-1655319342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b77273a0-b4bb-4d28-a576-f2393f97e238(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6d5b33-05a3-492e-be10-5082f37bfc03]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:43:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3a96be00-c025-46fd-913d-5dd2ffa3371e tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:49 devstack sudo[103071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238 Nov 02 15:43:49 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:50 devstack sudo[103062]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77 1073741824" returned: 0 in 0.469s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:50 devstack sudo[103073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77 Nov 02 15:43:50 devstack sudo[103073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:50 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3a96be00-c025-46fd-913d-5dd2ffa3371e tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238" returned: 0 in 0.389s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3a96be00-c025-46fd-913d-5dd2ffa3371e tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238.afbcbdf9-815b-4d34-bb23-db8d62f28423 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:50 devstack sudo[103078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238.afbcbdf9-815b-4d34-bb23-db8d62f28423 Nov 02 15:43:50 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:50 devstack sudo[103073]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77" returned: 0 in 0.248s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:50 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] <== create_volume: return (762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:43:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4346088-fec3-451e-b0a0-755260d9078c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ee64c4f-67fd-424e-af40-36e767d34d77', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7047af01-94ac-4fb4-b287-0a93f381a0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:50 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] Volume volume-1ee64c4f-67fd-424e-af40-36e767d34d77 (1ee64c4f-67fd-424e-af40-36e767d34d77): created successfully Nov 02 15:43:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7047af01-94ac-4fb4-b287-0a93f381a0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] Flow 'volume_create_manager' (c5aba76c-294e-44a4-a0c6-49ba2214eab5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:43:50 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-4aad0321-e1ac-4604-9c7a-b0119304e953 tempest-VolumeDependencyTests-795231677 None] Created volume successfully. Nov 02 15:43:50 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3a96be00-c025-46fd-913d-5dd2ffa3371e tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238.afbcbdf9-815b-4d34-bb23-db8d62f28423" returned: 0 in 0.350s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3a96be00-c025-46fd-913d-5dd2ffa3371e tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238.afbcbdf9-815b-4d34-bb23-db8d62f28423 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:50 devstack sudo[103084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238.afbcbdf9-815b-4d34-bb23-db8d62f28423 Nov 02 15:43:50 devstack sudo[103084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:50 devstack sudo[103084]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3a96be00-c025-46fd-913d-5dd2ffa3371e tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238.afbcbdf9-815b-4d34-bb23-db8d62f28423" returned: 0 in 0.240s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:50 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3a96be00-c025-46fd-913d-5dd2ffa3371e tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-quobyte-afbcbdf9-815b-4d34-bb23-db8d62f28423" released by "_delete_snapshot" :: held 1.497s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:43:50 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3a96be00-c025-46fd-913d-5dd2ffa3371e tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-quobyte-b77273a0-b4bb-4d28-a576-f2393f97e238" released by "delete_snapshot" :: held 1.521s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:43:50 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-3a96be00-c025-46fd-913d-5dd2ffa3371e tempest-VolumesSnapshotTestJSON-1655319342 None] Created reservations ['18cb49cf-8db1-4b9e-927b-70cbcf757446', 'ad269b1a-622f-43f5-b529-193d80932a56', '0aa43a9c-29c0-4b3c-b697-2e09fe25ae11', 'c63356da-83c7-47b5-968f-713c5b007985'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:43:50 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-3a96be00-c025-46fd-913d-5dd2ffa3371e tempest-VolumesSnapshotTestJSON-1655319342 None] Delete snapshot completed successfully. Nov 02 15:43:50 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3a96be00-c025-46fd-913d-5dd2ffa3371e tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-afbcbdf9-815b-4d34-bb23-db8d62f28423-delete_snapshot" released by "delete_snapshot" :: held 1.687s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:43:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-32ff791b-f93b-4ece-a717-d7bc2f982e3a tempest-VolumeDependencyTests-795231677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-32ff791b-f93b-4ece-a717-d7bc2f982e3a tempest-VolumeDependencyTests-795231677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:51 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-32ff791b-f93b-4ece-a717-d7bc2f982e3a tempest-VolumeDependencyTests-795231677 None] Creating offline snapshot 044a4ac7-c1ad-4f82-ad27-264590374126 of volume 1ee64c4f-67fd-424e-af40-36e767d34d77 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:43:51 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a67c85-4761-4307-bb9d-c36e47d721fb]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:43:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-32ff791b-f93b-4ece-a717-d7bc2f982e3a tempest-VolumeDependencyTests-795231677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:51 devstack sudo[103087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77 Nov 02 15:43:51 devstack sudo[103087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:52 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:43:52 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] Flow 'volume_create_manager' (d224eab0-7e8b-4ea3-b0a4-4742d458804b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:43:52 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693ad0ea-5e3b-45f1-920d-41e33806312d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:52 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693ad0ea-5e3b-45f1-920d-41e33806312d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1351907740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e01930c6-6dda-42f2-8bc8-3c4a74896a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='551fd347ecd44eb99c9a6d34709b8339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:43:52Z,use_quota=True,user_id='c3572d47d42942828dbbe784882a32bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:52 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e43111a-0fa3-47c2-88c0-ea591f191d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:52 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e43111a-0fa3-47c2-88c0-ea591f191d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:52 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14c131ee-f7ce-46a4-ab21-7b9a359b5ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:52 devstack sudo[103087]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:52 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14c131ee-f7ce-46a4-ab21-7b9a359b5ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e01930c6-6dda-42f2-8bc8-3c4a74896a44', 'volume_name': 'volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:52 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d7c5225-3f07-4c60-9ea9-d2f81228b50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:52 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d7c5225-3f07-4c60-9ea9-d2f81228b50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:52 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23e44b40-4625-440f-a8a8-59a50aa33185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:52 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] Volume e01930c6-6dda-42f2-8bc8-3c4a74896a44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44', 'volume_size': 1} Nov 02 15:43:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-32ff791b-f93b-4ece-a717-d7bc2f982e3a tempest-VolumeDependencyTests-795231677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77" returned: 0 in 0.408s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-32ff791b-f93b-4ece-a717-d7bc2f982e3a tempest-VolumeDependencyTests-795231677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77.044a4ac7-c1ad-4f82-ad27-264590374126 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:52 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77.044a4ac7-c1ad-4f82-ad27-264590374126 1G Nov 02 15:43:52 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:52 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-32ff791b-f93b-4ece-a717-d7bc2f982e3a tempest-VolumeDependencyTests-795231677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77.044a4ac7-c1ad-4f82-ad27-264590374126 1G" returned: 0 in 0.389s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-32ff791b-f93b-4ece-a717-d7bc2f982e3a tempest-VolumeDependencyTests-795231677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ee64c4f-67fd-424e-af40-36e767d34d77 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77.044a4ac7-c1ad-4f82-ad27-264590374126 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:52 devstack sudo[103097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ee64c4f-67fd-424e-af40-36e767d34d77 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77.044a4ac7-c1ad-4f82-ad27-264590374126 Nov 02 15:43:52 devstack sudo[103097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:52 devstack sudo[103097]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-32ff791b-f93b-4ece-a717-d7bc2f982e3a tempest-VolumeDependencyTests-795231677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ee64c4f-67fd-424e-af40-36e767d34d77 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77.044a4ac7-c1ad-4f82-ad27-264590374126" returned: 0 in 0.275s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:52 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-32ff791b-f93b-4ece-a717-d7bc2f982e3a tempest-VolumeDependencyTests-795231677 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77.044a4ac7-c1ad-4f82-ad27-264590374126 is being set with open permissions: ugo+rw Nov 02 15:43:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-32ff791b-f93b-4ece-a717-d7bc2f982e3a tempest-VolumeDependencyTests-795231677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77.044a4ac7-c1ad-4f82-ad27-264590374126 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:52 devstack sudo[103102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77.044a4ac7-c1ad-4f82-ad27-264590374126 Nov 02 15:43:52 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:53 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-32ff791b-f93b-4ece-a717-d7bc2f982e3a tempest-VolumeDependencyTests-795231677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77.044a4ac7-c1ad-4f82-ad27-264590374126" returned: 0 in 0.247s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-32ff791b-f93b-4ece-a717-d7bc2f982e3a tempest-VolumeDependencyTests-795231677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:53 devstack sudo[103105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77.info Nov 02 15:43:53 devstack sudo[103105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:53 devstack sudo[103105]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-32ff791b-f93b-4ece-a717-d7bc2f982e3a tempest-VolumeDependencyTests-795231677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77.info" returned: 0 in 0.245s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:53 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-32ff791b-f93b-4ece-a717-d7bc2f982e3a tempest-VolumeDependencyTests-795231677 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77.info is being set with open permissions: ugo+rw Nov 02 15:43:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-32ff791b-f93b-4ece-a717-d7bc2f982e3a tempest-VolumeDependencyTests-795231677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:53 devstack sudo[103108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77.info Nov 02 15:43:53 devstack sudo[103108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:53 devstack sudo[103108]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-32ff791b-f93b-4ece-a717-d7bc2f982e3a tempest-VolumeDependencyTests-795231677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77.info" returned: 0 in 0.247s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-32ff791b-f93b-4ece-a717-d7bc2f982e3a tempest-VolumeDependencyTests-795231677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.904s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.460s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:53 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:43:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1351907740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e01930c6-6dda-42f2-8bc8-3c4a74896a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='551fd347ecd44eb99c9a6d34709b8339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:43:52Z,use_quota=True,user_id='c3572d47d42942828dbbe784882a32bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:43:53 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] Creating volume e01930c6-6dda-42f2-8bc8-3c4a74896a44 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:43:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:53 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:43:53 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:43:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:53 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:43:53 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:43:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:53 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:UPDATE=178,cinder:SELECT=150,cinder:DELETE=17,cinder:INSERT=59 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:43:53 devstack sudo[103111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44 1073741824 Nov 02 15:43:53 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:53 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:UPDATE=176,cinder:SELECT=159,cinder:INSERT=58,cinder:DELETE=13 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:43:53 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-32ff791b-f93b-4ece-a717-d7bc2f982e3a tempest-VolumeDependencyTests-795231677 None] Create snapshot completed successfully Nov 02 15:43:54 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44 1073741824" returned: 0 in 0.444s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:54 devstack sudo[103116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44 Nov 02 15:43:54 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:54 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44" returned: 0 in 0.275s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23e44b40-4625-440f-a8a8-59a50aa33185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a87003-517f-4133-b3ee-ae5664bb9b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:54 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] Volume volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44 (e01930c6-6dda-42f2-8bc8-3c4a74896a44): created successfully Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a87003-517f-4133-b3ee-ae5664bb9b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] Flow 'volume_create_manager' (d224eab0-7e8b-4ea3-b0a4-4742d458804b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:43:54 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-eef7b950-2d2e-4721-8b7b-4fe73c45e174 tempest-VolumesSnapshotTestJSON-1655319342 None] Created volume successfully. Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Flow 'volume_create_manager' (b7631d0a-9b5c-400d-ac97-150fef2fb64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6229f0f9-46d0-42ca-ab59-6905b52175cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6229f0f9-46d0-42ca-ab59-6905b52175cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:43:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1437224951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=486092e1-9b54-4f87-b443-817c0ca8c04d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e04375bac2a34c22b9e6c782af80713e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=044a4ac7-c1ad-4f82-ad27-264590374126,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:43:54Z,use_quota=True,user_id='50483d50a0944d75949fbca8eecb30c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51787b41-1c55-4e6f-9ee1-3cb382551566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51787b41-1c55-4e6f-9ee1-3cb382551566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66844d49-050b-42e7-bc6b-b23042775ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66844d49-050b-42e7-bc6b-b23042775ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '486092e1-9b54-4f87-b443-817c0ca8c04d', 'volume_name': 'volume-486092e1-9b54-4f87-b443-817c0ca8c04d', 'volume_size': 1, 'snapshot_id': '044a4ac7-c1ad-4f82-ad27-264590374126'}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151dd6ec-d5c2-47dc-9fea-c0801900e3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (151dd6ec-d5c2-47dc-9fea-c0801900e3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc5a56f7-e84f-414d-8afc-aa1fbf4566a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:43:54 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Volume 486092e1-9b54-4f87-b443-817c0ca8c04d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-486092e1-9b54-4f87-b443-817c0ca8c04d', 'volume_size': 1, 'snapshot_id': '044a4ac7-c1ad-4f82-ad27-264590374126'} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Acquiring lock "cinder-quobyte-044a4ac7-c1ad-4f82-ad27-264590374126-486092e1-9b54-4f87-b443-817c0ca8c04d" by "_create_volume_from_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Lock "cinder-quobyte-044a4ac7-c1ad-4f82-ad27-264590374126-486092e1-9b54-4f87-b443-817c0ca8c04d" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Creating volume 486092e1-9b54-4f87-b443-817c0ca8c04d from snapshot 044a4ac7-c1ad-4f82-ad27-264590374126 {{(pid=86703) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Acquiring lock "cinder-quobyte-486092e1-9b54-4f87-b443-817c0ca8c04d" by "_copy_volume_from_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Lock "cinder-quobyte-486092e1-9b54-4f87-b443-817c0ca8c04d" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] snapshot: 044a4ac7-c1ad-4f82-ad27-264590374126, volume: 486092e1-9b54-4f87-b443-817c0ca8c04d, {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed4c71c-7231-457d-91dc-c6bd73236b72]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:43:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77.044a4ac7-c1ad-4f82-ad27-264590374126 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:54 devstack sudo[103119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77.044a4ac7-c1ad-4f82-ad27-264590374126 Nov 02 15:43:54 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:54 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77.044a4ac7-c1ad-4f82-ad27-264590374126" returned: 0 in 0.353s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:55 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ee64c4f-67fd-424e-af40-36e767d34d77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:43:55 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe77c530-367d-4676-9887-d5ada2459b8b]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:43:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:55 devstack sudo[103124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77 Nov 02 15:43:55 devstack sudo[103124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:43:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4be9c28a-711f-4edd-bf2f-9ad2b8b4a3ec tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:43:55 devstack sudo[103124]: pam_unix(sudo:session): session closed for user root Nov 02 15:43:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77" returned: 0 in 0.462s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:43:55 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] will copy from snapshot at /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77 {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 15:43:55 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Creating direct copy from snapshot {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 15:43:55 devstack cinder-volume[86703]: DEBUG cinder.utils [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Path /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-486092e1-9b54-4f87-b443-817c0ca8c04d not found in is_blk_device check {{(pid=86703) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 15:43:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-486092e1-9b54-4f87-b443-817c0ca8c04d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:43:55 devstack sudo[103130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-486092e1-9b54-4f87-b443-817c0ca8c04d Nov 02 15:43:55 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-486092e1-9b54-4f87-b443-817c0ca8c04d" returned: 0 in 7.377s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:02 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Image conversion details: src /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77, size 1024.00 MB, duration 7.38 sec, destination /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-486092e1-9b54-4f87-b443-817c0ca8c04d {{(pid=86703) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 15:44:02 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Converted 1024.00 MB image at 138.78 MB/s Nov 02 15:44:02 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-486092e1-9b54-4f87-b443-817c0ca8c04d is being set with open permissions: ugo+rw Nov 02 15:44:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-486092e1-9b54-4f87-b443-817c0ca8c04d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:02 devstack sudo[103215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-486092e1-9b54-4f87-b443-817c0ca8c04d Nov 02 15:44:02 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:02 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-90634d5e-618a-44a1-ad8f-b889773e1b10 req-02f522ce-c671-46a7-827f-3e991bca29ef tempest-TestShelveInstance-1430468173 None] Terminate volume connection completed successfully. Nov 02 15:44:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-90634d5e-618a-44a1-ad8f-b889773e1b10 req-02f522ce-c671-46a7-827f-3e991bca29ef tempest-TestShelveInstance-1430468173 None] Deleting attachment fe4ab3a5-8913-49f5-b299-53efbb327ffd. {{(pid=86703) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 15:44:03 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-486092e1-9b54-4f87-b443-817c0ca8c04d" returned: 0 in 0.254s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Lock "cinder-quobyte-486092e1-9b54-4f87-b443-817c0ca8c04d" released by "_copy_volume_from_snapshot" :: held 8.529s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:44:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Lock "cinder-quobyte-044a4ac7-c1ad-4f82-ad27-264590374126-486092e1-9b54-4f87-b443-817c0ca8c04d" released by "_create_volume_from_snapshot" :: held 8.588s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:44:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.605s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:44:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4be9c28a-711f-4edd-bf2f-9ad2b8b4a3ec tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.736s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:44:03 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-4be9c28a-711f-4edd-bf2f-9ad2b8b4a3ec tempest-VolumesSnapshotTestJSON-1655319342 None] Creating offline snapshot 2f7da412-e29c-4326-abd7-b4a4ea2dae23 of volume e01930c6-6dda-42f2-8bc8-3c4a74896a44 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:44:03 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc5a56f7-e84f-414d-8afc-aa1fbf4566a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-486092e1-9b54-4f87-b443-817c0ca8c04d', 'volume_size': 1, 'snapshot_id': '044a4ac7-c1ad-4f82-ad27-264590374126'}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:44:03 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f05c143-b3a6-4614-9958-08c9e9b9e288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:44:03 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e83faa-28a6-4659-8c8a-80ec1cc0fd5e]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:44:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4be9c28a-711f-4edd-bf2f-9ad2b8b4a3ec tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:03 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Volume volume-486092e1-9b54-4f87-b443-817c0ca8c04d (486092e1-9b54-4f87-b443-817c0ca8c04d): created successfully Nov 02 15:44:03 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f05c143-b3a6-4614-9958-08c9e9b9e288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:44:03 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Flow 'volume_create_manager' (b7631d0a-9b5c-400d-ac97-150fef2fb64d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:44:03 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-77a1a23b-259f-41cd-97d7-02b631356b72 tempest-VolumeDependencyTests-795231677 None] Created volume successfully. Nov 02 15:44:03 devstack sudo[103218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44 Nov 02 15:44:03 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ee14e2d6-553b-466d-9bdb-bf848d29fa5f tempest-VolumeDependencyTests-795231677 None] Acquiring lock "cinder-044a4ac7-c1ad-4f82-ad27-264590374126-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:44:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ee14e2d6-553b-466d-9bdb-bf848d29fa5f tempest-VolumeDependencyTests-795231677 None] Lock "cinder-044a4ac7-c1ad-4f82-ad27-264590374126-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:44:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ee14e2d6-553b-466d-9bdb-bf848d29fa5f tempest-VolumeDependencyTests-795231677 None] Acquiring lock "cinder-quobyte-1ee64c4f-67fd-424e-af40-36e767d34d77" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:44:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ee14e2d6-553b-466d-9bdb-bf848d29fa5f tempest-VolumeDependencyTests-795231677 None] Lock "cinder-quobyte-1ee64c4f-67fd-424e-af40-36e767d34d77" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:44:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ee14e2d6-553b-466d-9bdb-bf848d29fa5f tempest-VolumeDependencyTests-795231677 None] Acquiring lock "cinder-quobyte-044a4ac7-c1ad-4f82-ad27-264590374126" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:44:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ee14e2d6-553b-466d-9bdb-bf848d29fa5f tempest-VolumeDependencyTests-795231677 None] Lock "cinder-quobyte-044a4ac7-c1ad-4f82-ad27-264590374126" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:44:03 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:03 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-ee14e2d6-553b-466d-9bdb-bf848d29fa5f tempest-VolumeDependencyTests-795231677 None] Deleting offline snapshot 044a4ac7-c1ad-4f82-ad27-264590374126 of volume 1ee64c4f-67fd-424e-af40-36e767d34d77 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:44:03 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-ee14e2d6-553b-466d-9bdb-bf848d29fa5f tempest-VolumeDependencyTests-795231677 None] snapshot_file for this snap is: volume-1ee64c4f-67fd-424e-af40-36e767d34d77.044a4ac7-c1ad-4f82-ad27-264590374126 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:44:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4be9c28a-711f-4edd-bf2f-9ad2b8b4a3ec tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44" returned: 0 in 0.418s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4be9c28a-711f-4edd-bf2f-9ad2b8b4a3ec tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44.2f7da412-e29c-4326-abd7-b4a4ea2dae23 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:03 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbddc54-d9b2-47ea-afa5-f9dc997d48d2]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:44:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ee14e2d6-553b-466d-9bdb-bf848d29fa5f tempest-VolumeDependencyTests-795231677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77.044a4ac7-c1ad-4f82-ad27-264590374126 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:03 devstack sudo[103230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44.2f7da412-e29c-4326-abd7-b4a4ea2dae23 1G Nov 02 15:44:03 devstack sudo[103230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:03 devstack sudo[103231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77.044a4ac7-c1ad-4f82-ad27-264590374126 Nov 02 15:44:03 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:03 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ee14e2d6-553b-466d-9bdb-bf848d29fa5f tempest-VolumeDependencyTests-795231677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77.044a4ac7-c1ad-4f82-ad27-264590374126" returned: 0 in 0.357s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:04 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-ee14e2d6-553b-466d-9bdb-bf848d29fa5f tempest-VolumeDependencyTests-795231677 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ee64c4f-67fd-424e-af40-36e767d34d77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:44:04 devstack sudo[103230]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4be9c28a-711f-4edd-bf2f-9ad2b8b4a3ec tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44.2f7da412-e29c-4326-abd7-b4a4ea2dae23 1G" returned: 0 in 0.401s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4be9c28a-711f-4edd-bf2f-9ad2b8b4a3ec tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44.2f7da412-e29c-4326-abd7-b4a4ea2dae23 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:04 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[651d87ea-a1a7-469b-ae0a-078629f6e5b2]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:44:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ee14e2d6-553b-466d-9bdb-bf848d29fa5f tempest-VolumeDependencyTests-795231677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:04 devstack sudo[103241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44.2f7da412-e29c-4326-abd7-b4a4ea2dae23 Nov 02 15:44:04 devstack sudo[103241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:04 devstack sudo[103242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77 Nov 02 15:44:04 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:04 devstack sudo[103241]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4be9c28a-711f-4edd-bf2f-9ad2b8b4a3ec tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44.2f7da412-e29c-4326-abd7-b4a4ea2dae23" returned: 0 in 0.319s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:04 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-4be9c28a-711f-4edd-bf2f-9ad2b8b4a3ec tempest-VolumesSnapshotTestJSON-1655319342 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44.2f7da412-e29c-4326-abd7-b4a4ea2dae23 is being set with open permissions: ugo+rw Nov 02 15:44:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4be9c28a-711f-4edd-bf2f-9ad2b8b4a3ec tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44.2f7da412-e29c-4326-abd7-b4a4ea2dae23 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:04 devstack sudo[103249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44.2f7da412-e29c-4326-abd7-b4a4ea2dae23 Nov 02 15:44:04 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:04 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4be9c28a-711f-4edd-bf2f-9ad2b8b4a3ec tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44.2f7da412-e29c-4326-abd7-b4a4ea2dae23" returned: 0 in 0.310s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:04 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4be9c28a-711f-4edd-bf2f-9ad2b8b4a3ec tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ee14e2d6-553b-466d-9bdb-bf848d29fa5f tempest-VolumeDependencyTests-795231677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77" returned: 0 in 0.660s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ee14e2d6-553b-466d-9bdb-bf848d29fa5f tempest-VolumeDependencyTests-795231677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77.044a4ac7-c1ad-4f82-ad27-264590374126 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:04 devstack sudo[103256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44.info Nov 02 15:44:04 devstack sudo[103256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:04 devstack sudo[103257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77.044a4ac7-c1ad-4f82-ad27-264590374126 Nov 02 15:44:04 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:04 devstack sudo[103256]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4be9c28a-711f-4edd-bf2f-9ad2b8b4a3ec tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44.info" returned: 0 in 0.271s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:04 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-4be9c28a-711f-4edd-bf2f-9ad2b8b4a3ec tempest-VolumesSnapshotTestJSON-1655319342 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44.info is being set with open permissions: ugo+rw Nov 02 15:44:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4be9c28a-711f-4edd-bf2f-9ad2b8b4a3ec tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:05 devstack sudo[103264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44.info Nov 02 15:44:05 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:05 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ee14e2d6-553b-466d-9bdb-bf848d29fa5f tempest-VolumeDependencyTests-795231677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77.044a4ac7-c1ad-4f82-ad27-264590374126" returned: 0 in 0.361s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ee14e2d6-553b-466d-9bdb-bf848d29fa5f tempest-VolumeDependencyTests-795231677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77.044a4ac7-c1ad-4f82-ad27-264590374126 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:05 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77.044a4ac7-c1ad-4f82-ad27-264590374126 Nov 02 15:44:05 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:05 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4be9c28a-711f-4edd-bf2f-9ad2b8b4a3ec tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44.info" returned: 0 in 0.257s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4be9c28a-711f-4edd-bf2f-9ad2b8b4a3ec tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.093s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:44:05 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-4be9c28a-711f-4edd-bf2f-9ad2b8b4a3ec tempest-VolumesSnapshotTestJSON-1655319342 None] Create snapshot completed successfully Nov 02 15:44:05 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ee14e2d6-553b-466d-9bdb-bf848d29fa5f tempest-VolumeDependencyTests-795231677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77.044a4ac7-c1ad-4f82-ad27-264590374126" returned: 0 in 0.263s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:05 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ee14e2d6-553b-466d-9bdb-bf848d29fa5f tempest-VolumeDependencyTests-795231677 None] Lock "cinder-quobyte-044a4ac7-c1ad-4f82-ad27-264590374126" released by "_delete_snapshot" :: held 1.776s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:44:05 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ee14e2d6-553b-466d-9bdb-bf848d29fa5f tempest-VolumeDependencyTests-795231677 None] Lock "cinder-quobyte-1ee64c4f-67fd-424e-af40-36e767d34d77" released by "delete_snapshot" :: held 1.801s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:44:05 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-ee14e2d6-553b-466d-9bdb-bf848d29fa5f tempest-VolumeDependencyTests-795231677 None] Created reservations ['adfe815d-76cf-4ac1-a6ee-50ff8b87969c', 'f3b86647-222b-4d00-a083-4f7abd7d3692', '6828751e-db87-488a-b426-8f51248d0721', 'ef30b845-ea6d-4210-8fce-ef9d298ce66a'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:44:05 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-ee14e2d6-553b-466d-9bdb-bf848d29fa5f tempest-VolumeDependencyTests-795231677 None] Delete snapshot completed successfully. Nov 02 15:44:05 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ee14e2d6-553b-466d-9bdb-bf848d29fa5f tempest-VolumeDependencyTests-795231677 None] Lock "cinder-044a4ac7-c1ad-4f82-ad27-264590374126-delete_snapshot" released by "delete_snapshot" :: held 1.951s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:44:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-8d71fdf6-406e-489e-ab99-1716d015b1fc req-550719f6-f70a-4c8d-b900-2b88ac4974f6 tempest-TestShelveInstance-1430468173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:44:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-8d71fdf6-406e-489e-ab99-1716d015b1fc req-550719f6-f70a-4c8d-b900-2b88ac4974f6 tempest-TestShelveInstance-1430468173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:44:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-8d71fdf6-406e-489e-ab99-1716d015b1fc req-550719f6-f70a-4c8d-b900-2b88ac4974f6 tempest-TestShelveInstance-1430468173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:44:05 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-8d71fdf6-406e-489e-ab99-1716d015b1fc req-550719f6-f70a-4c8d-b900-2b88ac4974f6 tempest-TestShelveInstance-1430468173 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478', 'name': 'volume-ba3c99cc-5784-4c45-97fa-241790a249d8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0bdd8b6d-2896-49b0-b8b1-8de8c4da2c80', 'enforce_multipath': True} {{(pid=86703) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 15:44:05 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-8d71fdf6-406e-489e-ab99-1716d015b1fc req-550719f6-f70a-4c8d-b900-2b88ac4974f6 tempest-TestShelveInstance-1430468173 None] attachment_update completed successfully. Nov 02 15:44:05 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-07923855-27a3-40c0-ac8c-99663e41ee29 tempest-VolumeDependencyTests-795231677 None] Acquiring lock "cinder-1ee64c4f-67fd-424e-af40-36e767d34d77-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:44:05 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-07923855-27a3-40c0-ac8c-99663e41ee29 tempest-VolumeDependencyTests-795231677 None] Lock "cinder-1ee64c4f-67fd-424e-af40-36e767d34d77-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:44:05 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-07923855-27a3-40c0-ac8c-99663e41ee29 tempest-VolumeDependencyTests-795231677 None] Acquiring lock "cinder-quobyte-1ee64c4f-67fd-424e-af40-36e767d34d77" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:44:05 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-07923855-27a3-40c0-ac8c-99663e41ee29 tempest-VolumeDependencyTests-795231677 None] Lock "cinder-quobyte-1ee64c4f-67fd-424e-af40-36e767d34d77" acquired by "delete_volume" :: waited 0.025s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:44:05 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fda757-087b-4483-a202-efcf3c7acef8]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:44:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-07923855-27a3-40c0-ac8c-99663e41ee29 tempest-VolumeDependencyTests-795231677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:06 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77 Nov 02 15:44:06 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:06 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-07923855-27a3-40c0-ac8c-99663e41ee29 tempest-VolumeDependencyTests-795231677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77" returned: 0 in 0.420s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-07923855-27a3-40c0-ac8c-99663e41ee29 tempest-VolumeDependencyTests-795231677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:06 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77 Nov 02 15:44:06 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:44:06 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Flow 'volume_create_manager' (85f77028-0f78-4bbb-8bb6-c89093a98f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c36ebe5-a250-48fc-9931-e30ec0e932df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-07923855-27a3-40c0-ac8c-99663e41ee29 tempest-VolumeDependencyTests-795231677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ee64c4f-67fd-424e-af40-36e767d34d77" returned: 0 in 0.327s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c36ebe5-a250-48fc-9931-e30ec0e932df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-112659973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45a50046-74fc-4633-a543-3e4c87af29fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='551fd347ecd44eb99c9a6d34709b8339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:44:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=2f7da412-e29c-4326-abd7-b4a4ea2dae23,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:44:07Z,use_quota=True,user_id='c3572d47d42942828dbbe784882a32bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf38808b-88dd-4e73-bdda-d9a435dd5546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf38808b-88dd-4e73-bdda-d9a435dd5546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (142a0dfd-33b4-4b63-8be8-c22950e97de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (142a0dfd-33b4-4b63-8be8-c22950e97de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '45a50046-74fc-4633-a543-3e4c87af29fc', 'volume_name': 'volume-45a50046-74fc-4633-a543-3e4c87af29fc', 'volume_size': 2, 'snapshot_id': '2f7da412-e29c-4326-abd7-b4a4ea2dae23'}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (057f4149-69a3-4c6f-94fa-51375c98c774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (057f4149-69a3-4c6f-94fa-51375c98c774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0923144-e369-41f3-ae3c-5dc64b8d23aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:44:06 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Volume 45a50046-74fc-4633-a543-3e4c87af29fc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-45a50046-74fc-4633-a543-3e4c87af29fc', 'volume_size': 2, 'snapshot_id': '2f7da412-e29c-4326-abd7-b4a4ea2dae23'} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-07923855-27a3-40c0-ac8c-99663e41ee29 tempest-VolumeDependencyTests-795231677 None] Lock "cinder-quobyte-1ee64c4f-67fd-424e-af40-36e767d34d77" released by "delete_volume" :: held 0.888s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "cinder-quobyte-2f7da412-e29c-4326-abd7-b4a4ea2dae23-45a50046-74fc-4633-a543-3e4c87af29fc" by "_create_volume_from_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-quobyte-2f7da412-e29c-4326-abd7-b4a4ea2dae23-45a50046-74fc-4633-a543-3e4c87af29fc" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Creating volume 45a50046-74fc-4633-a543-3e4c87af29fc from snapshot 2f7da412-e29c-4326-abd7-b4a4ea2dae23 {{(pid=86703) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "cinder-quobyte-45a50046-74fc-4633-a543-3e4c87af29fc" by "_copy_volume_from_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-quobyte-45a50046-74fc-4633-a543-3e4c87af29fc" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] snapshot: 2f7da412-e29c-4326-abd7-b4a4ea2dae23, volume: 45a50046-74fc-4633-a543-3e4c87af29fc, {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-07923855-27a3-40c0-ac8c-99663e41ee29 tempest-VolumeDependencyTests-795231677 None] Created reservations ['394a59ad-63e8-4973-8637-11c87290e167', '33ad1188-3808-4a2d-9832-4711dfc9848a', '28bf1100-b865-4695-8355-35be778319b7', '9e106782-b5a8-495d-a6c8-de9d65016d77'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[14898fc4-3372-4aca-be72-e49be3d67bcf]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44.2f7da412-e29c-4326-abd7-b4a4ea2dae23 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-07923855-27a3-40c0-ac8c-99663e41ee29 tempest-VolumeDependencyTests-795231677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-07923855-27a3-40c0-ac8c-99663e41ee29 tempest-VolumeDependencyTests-795231677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-07923855-27a3-40c0-ac8c-99663e41ee29 tempest-VolumeDependencyTests-795231677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-07923855-27a3-40c0-ac8c-99663e41ee29 tempest-VolumeDependencyTests-795231677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-07923855-27a3-40c0-ac8c-99663e41ee29 tempest-VolumeDependencyTests-795231677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:44:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-07923855-27a3-40c0-ac8c-99663e41ee29 tempest-VolumeDependencyTests-795231677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:06 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:44:06 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:07 devstack sudo[103287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44.2f7da412-e29c-4326-abd7-b4a4ea2dae23 Nov 02 15:44:07 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:07 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-07923855-27a3-40c0-ac8c-99663e41ee29 tempest-VolumeDependencyTests-795231677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.290s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:07 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-07923855-27a3-40c0-ac8c-99663e41ee29 tempest-VolumeDependencyTests-795231677 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:44:07 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-07923855-27a3-40c0-ac8c-99663e41ee29 tempest-VolumeDependencyTests-795231677 None] Deleted volume successfully. Nov 02 15:44:07 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-07923855-27a3-40c0-ac8c-99663e41ee29 tempest-VolumeDependencyTests-795231677 None] Lock "cinder-1ee64c4f-67fd-424e-af40-36e767d34d77-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:44:07 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44.2f7da412-e29c-4326-abd7-b4a4ea2dae23" returned: 0 in 0.437s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:07 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:44:07 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f2900f-561f-4cb9-8e52-caeb3e91219b]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:44:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:07 devstack sudo[103295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44 Nov 02 15:44:07 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:07 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44" returned: 0 in 0.397s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:07 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] will copy from snapshot at /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44 {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 15:44:07 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Creating direct copy from snapshot {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 15:44:07 devstack cinder-volume[86703]: DEBUG cinder.utils [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Path /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-45a50046-74fc-4633-a543-3e4c87af29fc not found in is_blk_device check {{(pid=86703) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 15:44:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-45a50046-74fc-4633-a543-3e4c87af29fc {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:07 devstack sudo[103301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-45a50046-74fc-4633-a543-3e4c87af29fc Nov 02 15:44:07 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:08 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3db6775a-572d-40bf-b656-9c25fdf31a34 tempest-VolumeDependencyTests-795231677 None] Acquiring lock "cinder-486092e1-9b54-4f87-b443-817c0ca8c04d-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:44:08 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3db6775a-572d-40bf-b656-9c25fdf31a34 tempest-VolumeDependencyTests-795231677 None] Lock "cinder-486092e1-9b54-4f87-b443-817c0ca8c04d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:44:08 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3db6775a-572d-40bf-b656-9c25fdf31a34 tempest-VolumeDependencyTests-795231677 None] Acquiring lock "cinder-quobyte-486092e1-9b54-4f87-b443-817c0ca8c04d" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:44:08 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3db6775a-572d-40bf-b656-9c25fdf31a34 tempest-VolumeDependencyTests-795231677 None] Lock "cinder-quobyte-486092e1-9b54-4f87-b443-817c0ca8c04d" acquired by "delete_volume" :: waited 0.020s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:44:08 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea44502a-9f21-4a21-b922-d6df9235fef8]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:44:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3db6775a-572d-40bf-b656-9c25fdf31a34 tempest-VolumeDependencyTests-795231677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-486092e1-9b54-4f87-b443-817c0ca8c04d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:08 devstack sudo[103307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-486092e1-9b54-4f87-b443-817c0ca8c04d Nov 02 15:44:08 devstack sudo[103307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:08 devstack sudo[103307]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3db6775a-572d-40bf-b656-9c25fdf31a34 tempest-VolumeDependencyTests-795231677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-486092e1-9b54-4f87-b443-817c0ca8c04d" returned: 0 in 0.833s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3db6775a-572d-40bf-b656-9c25fdf31a34 tempest-VolumeDependencyTests-795231677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-486092e1-9b54-4f87-b443-817c0ca8c04d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:09 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-486092e1-9b54-4f87-b443-817c0ca8c04d Nov 02 15:44:09 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:09 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3db6775a-572d-40bf-b656-9c25fdf31a34 tempest-VolumeDependencyTests-795231677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-486092e1-9b54-4f87-b443-817c0ca8c04d" returned: 0 in 0.746s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:09 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3db6775a-572d-40bf-b656-9c25fdf31a34 tempest-VolumeDependencyTests-795231677 None] Lock "cinder-quobyte-486092e1-9b54-4f87-b443-817c0ca8c04d" released by "delete_volume" :: held 1.653s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:44:09 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-3db6775a-572d-40bf-b656-9c25fdf31a34 tempest-VolumeDependencyTests-795231677 None] Created reservations ['ba78a41e-fb38-4a8e-8a3e-da44cb70533c', 'dbc6060a-e027-4a80-b1e7-b0dff602493e', 'f15ca3ba-b59e-47f3-a7c3-68336682e9d4', '6ca522a7-2f2b-425b-a157-85adc5229fdf'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:44:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-3db6775a-572d-40bf-b656-9c25fdf31a34 tempest-VolumeDependencyTests-795231677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:44:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-3db6775a-572d-40bf-b656-9c25fdf31a34 tempest-VolumeDependencyTests-795231677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:44:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-3db6775a-572d-40bf-b656-9c25fdf31a34 tempest-VolumeDependencyTests-795231677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:44:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-3db6775a-572d-40bf-b656-9c25fdf31a34 tempest-VolumeDependencyTests-795231677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:44:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-3db6775a-572d-40bf-b656-9c25fdf31a34 tempest-VolumeDependencyTests-795231677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:44:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3db6775a-572d-40bf-b656-9c25fdf31a34 tempest-VolumeDependencyTests-795231677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:10 devstack sudo[103785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:44:10 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:10 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3db6775a-572d-40bf-b656-9c25fdf31a34 tempest-VolumeDependencyTests-795231677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.578s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:10 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-3db6775a-572d-40bf-b656-9c25fdf31a34 tempest-VolumeDependencyTests-795231677 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:44:10 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-3db6775a-572d-40bf-b656-9c25fdf31a34 tempest-VolumeDependencyTests-795231677 None] Deleted volume successfully. Nov 02 15:44:10 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3db6775a-572d-40bf-b656-9c25fdf31a34 tempest-VolumeDependencyTests-795231677 None] Lock "cinder-486092e1-9b54-4f87-b443-817c0ca8c04d-delete_volume" released by "delete_volume" :: held 2.795s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:44:18 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-45a50046-74fc-4633-a543-3e4c87af29fc" returned: 0 in 10.726s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:18 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Image conversion details: src /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44, size 1024.00 MB, duration 10.73 sec, destination /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-45a50046-74fc-4633-a543-3e4c87af29fc {{(pid=86703) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 15:44:18 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Converted 1024.00 MB image at 95.46 MB/s Nov 02 15:44:18 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-45a50046-74fc-4633-a543-3e4c87af29fc is being set with open permissions: ugo+rw Nov 02 15:44:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-45a50046-74fc-4633-a543-3e4c87af29fc {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:18 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-45a50046-74fc-4633-a543-3e4c87af29fc Nov 02 15:44:18 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:18 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-45a50046-74fc-4633-a543-3e4c87af29fc" returned: 0 in 0.288s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:18 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-quobyte-45a50046-74fc-4633-a543-3e4c87af29fc" released by "_copy_volume_from_snapshot" :: held 11.968s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:44:18 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-quobyte-2f7da412-e29c-4326-abd7-b4a4ea2dae23-45a50046-74fc-4633-a543-3e4c87af29fc" released by "_create_volume_from_snapshot" :: held 12.055s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:44:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.077s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:44:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0923144-e369-41f3-ae3c-5dc64b8d23aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45a50046-74fc-4633-a543-3e4c87af29fc', 'volume_size': 2, 'snapshot_id': '2f7da412-e29c-4326-abd7-b4a4ea2dae23'}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:44:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d43afe48-38af-4b81-a380-0b72f2d6981a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:44:18 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Volume volume-45a50046-74fc-4633-a543-3e4c87af29fc (45a50046-74fc-4633-a543-3e4c87af29fc): created successfully Nov 02 15:44:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d43afe48-38af-4b81-a380-0b72f2d6981a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:44:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Flow 'volume_create_manager' (85f77028-0f78-4bbb-8bb6-c89093a98f16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:44:18 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-791c7c30-feb2-43e9-91e5-4c865868c9fe tempest-VolumesSnapshotTestJSON-1655319342 None] Created volume successfully. Nov 02 15:44:19 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-aea928b2-5ffc-42ee-9fe0-55d89b5241be tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "cinder-45a50046-74fc-4633-a543-3e4c87af29fc-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:44:19 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-aea928b2-5ffc-42ee-9fe0-55d89b5241be tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-45a50046-74fc-4633-a543-3e4c87af29fc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:44:19 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-aea928b2-5ffc-42ee-9fe0-55d89b5241be tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "cinder-quobyte-45a50046-74fc-4633-a543-3e4c87af29fc" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:44:19 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-aea928b2-5ffc-42ee-9fe0-55d89b5241be tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-quobyte-45a50046-74fc-4633-a543-3e4c87af29fc" acquired by "delete_volume" :: waited 0.023s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:44:19 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5810d436-2132-4d5e-a296-39be52494dab]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:44:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-aea928b2-5ffc-42ee-9fe0-55d89b5241be tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-45a50046-74fc-4633-a543-3e4c87af29fc {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:19 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-45a50046-74fc-4633-a543-3e4c87af29fc Nov 02 15:44:19 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:19 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-aea928b2-5ffc-42ee-9fe0-55d89b5241be tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-45a50046-74fc-4633-a543-3e4c87af29fc" returned: 0 in 0.455s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-aea928b2-5ffc-42ee-9fe0-55d89b5241be tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-45a50046-74fc-4633-a543-3e4c87af29fc {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:20 devstack sudo[103818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-45a50046-74fc-4633-a543-3e4c87af29fc Nov 02 15:44:20 devstack sudo[103818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:20 devstack sudo[103818]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-aea928b2-5ffc-42ee-9fe0-55d89b5241be tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-45a50046-74fc-4633-a543-3e4c87af29fc" returned: 0 in 0.313s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:20 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-aea928b2-5ffc-42ee-9fe0-55d89b5241be tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-quobyte-45a50046-74fc-4633-a543-3e4c87af29fc" released by "delete_volume" :: held 0.832s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:44:20 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-aea928b2-5ffc-42ee-9fe0-55d89b5241be tempest-VolumesSnapshotTestJSON-1655319342 None] Created reservations ['6a920469-ccc5-4bde-8220-9f8313781dc9', '2644689b-0765-428c-b39a-8666c199de41', '35f4053b-7f8b-4f87-9403-71247c2c9678', 'a511dec3-4f11-4c78-8a60-14c5bad35dc9'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:44:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-aea928b2-5ffc-42ee-9fe0-55d89b5241be tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:44:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-aea928b2-5ffc-42ee-9fe0-55d89b5241be tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:44:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-aea928b2-5ffc-42ee-9fe0-55d89b5241be tempest-VolumesSnapshotTestJSON-1655319342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:44:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-aea928b2-5ffc-42ee-9fe0-55d89b5241be tempest-VolumesSnapshotTestJSON-1655319342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:44:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-aea928b2-5ffc-42ee-9fe0-55d89b5241be tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:44:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-aea928b2-5ffc-42ee-9fe0-55d89b5241be tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:20 devstack sudo[103821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:44:20 devstack sudo[103821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:20 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:44:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:44:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:44:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:44:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:44:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:44:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:20 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f62c51d8-9f3b-43eb-a595-5fabc9f566c1 tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "cinder-2f7da412-e29c-4326-abd7-b4a4ea2dae23-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:44:20 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f62c51d8-9f3b-43eb-a595-5fabc9f566c1 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-2f7da412-e29c-4326-abd7-b4a4ea2dae23-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:44:20 devstack sudo[103823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:44:20 devstack sudo[103823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:20 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f62c51d8-9f3b-43eb-a595-5fabc9f566c1 tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "cinder-quobyte-e01930c6-6dda-42f2-8bc8-3c4a74896a44" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:44:20 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f62c51d8-9f3b-43eb-a595-5fabc9f566c1 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-quobyte-e01930c6-6dda-42f2-8bc8-3c4a74896a44" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:44:20 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f62c51d8-9f3b-43eb-a595-5fabc9f566c1 tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "cinder-quobyte-2f7da412-e29c-4326-abd7-b4a4ea2dae23" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:44:20 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f62c51d8-9f3b-43eb-a595-5fabc9f566c1 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-quobyte-2f7da412-e29c-4326-abd7-b4a4ea2dae23" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:44:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-f62c51d8-9f3b-43eb-a595-5fabc9f566c1 tempest-VolumesSnapshotTestJSON-1655319342 None] Deleting offline snapshot 2f7da412-e29c-4326-abd7-b4a4ea2dae23 of volume e01930c6-6dda-42f2-8bc8-3c4a74896a44 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:44:20 devstack sudo[103821]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-f62c51d8-9f3b-43eb-a595-5fabc9f566c1 tempest-VolumesSnapshotTestJSON-1655319342 None] snapshot_file for this snap is: volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44.2f7da412-e29c-4326-abd7-b4a4ea2dae23 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:44:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-aea928b2-5ffc-42ee-9fe0-55d89b5241be tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.344s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:20 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-aea928b2-5ffc-42ee-9fe0-55d89b5241be tempest-VolumesSnapshotTestJSON-1655319342 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:44:20 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[803e8ffa-6537-47b2-9323-e5975b7bf833]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:44:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f62c51d8-9f3b-43eb-a595-5fabc9f566c1 tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44.2f7da412-e29c-4326-abd7-b4a4ea2dae23 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:20 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-aea928b2-5ffc-42ee-9fe0-55d89b5241be tempest-VolumesSnapshotTestJSON-1655319342 None] Deleted volume successfully. Nov 02 15:44:20 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-aea928b2-5ffc-42ee-9fe0-55d89b5241be tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-45a50046-74fc-4633-a543-3e4c87af29fc-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:44:21 devstack sudo[103826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44.2f7da412-e29c-4326-abd7-b4a4ea2dae23 Nov 02 15:44:21 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:21 devstack sudo[103823]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.393s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:21 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:44:21 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager._thread_info {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:44:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread count: 29 {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 15:44:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread info: [<_MainThread(MainThread, started 125876361756800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 15:44:21 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f62c51d8-9f3b-43eb-a595-5fabc9f566c1 tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44.2f7da412-e29c-4326-abd7-b4a4ea2dae23" returned: 0 in 0.435s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:21 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-f62c51d8-9f3b-43eb-a595-5fabc9f566c1 tempest-VolumesSnapshotTestJSON-1655319342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:44:21 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5488c2-b86a-4604-9089-85d87c31b279]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:44:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f62c51d8-9f3b-43eb-a595-5fabc9f566c1 tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:21 devstack sudo[103832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44 Nov 02 15:44:21 devstack sudo[103832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:21 devstack sudo[103832]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f62c51d8-9f3b-43eb-a595-5fabc9f566c1 tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44" returned: 0 in 0.626s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f62c51d8-9f3b-43eb-a595-5fabc9f566c1 tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44.2f7da412-e29c-4326-abd7-b4a4ea2dae23 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:21 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44.2f7da412-e29c-4326-abd7-b4a4ea2dae23 Nov 02 15:44:21 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:22 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f62c51d8-9f3b-43eb-a595-5fabc9f566c1 tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44.2f7da412-e29c-4326-abd7-b4a4ea2dae23" returned: 0 in 0.435s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f62c51d8-9f3b-43eb-a595-5fabc9f566c1 tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44.2f7da412-e29c-4326-abd7-b4a4ea2dae23 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:22 devstack sudo[103843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44.2f7da412-e29c-4326-abd7-b4a4ea2dae23 Nov 02 15:44:22 devstack sudo[103843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:22 devstack sudo[103843]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f62c51d8-9f3b-43eb-a595-5fabc9f566c1 tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44.2f7da412-e29c-4326-abd7-b4a4ea2dae23" returned: 0 in 0.284s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:22 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f62c51d8-9f3b-43eb-a595-5fabc9f566c1 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-quobyte-2f7da412-e29c-4326-abd7-b4a4ea2dae23" released by "_delete_snapshot" :: held 1.948s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:44:22 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f62c51d8-9f3b-43eb-a595-5fabc9f566c1 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-quobyte-e01930c6-6dda-42f2-8bc8-3c4a74896a44" released by "delete_snapshot" :: held 1.987s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:44:22 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-f62c51d8-9f3b-43eb-a595-5fabc9f566c1 tempest-VolumesSnapshotTestJSON-1655319342 None] Created reservations ['fb2dd99c-fae2-46bd-abe5-bb49062bcf0e', '3454111c-c20b-4027-88fb-2db5b9b11ec6', 'b6483e66-cc9f-4314-96cb-a51d1e8f3512', '1cf1e8f5-b3fe-4303-9fde-a825c8e3f3da'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:44:22 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-f62c51d8-9f3b-43eb-a595-5fabc9f566c1 tempest-VolumesSnapshotTestJSON-1655319342 None] Delete snapshot completed successfully. Nov 02 15:44:22 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f62c51d8-9f3b-43eb-a595-5fabc9f566c1 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-2f7da412-e29c-4326-abd7-b4a4ea2dae23-delete_snapshot" released by "delete_snapshot" :: held 2.200s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:44:23 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ba47fc89-5773-4409-98f6-e64ff13d6e0a tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "cinder-e01930c6-6dda-42f2-8bc8-3c4a74896a44-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:44:24 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ba47fc89-5773-4409-98f6-e64ff13d6e0a tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-e01930c6-6dda-42f2-8bc8-3c4a74896a44-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:44:24 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ba47fc89-5773-4409-98f6-e64ff13d6e0a tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "cinder-quobyte-e01930c6-6dda-42f2-8bc8-3c4a74896a44" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:44:24 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ba47fc89-5773-4409-98f6-e64ff13d6e0a tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-quobyte-e01930c6-6dda-42f2-8bc8-3c4a74896a44" acquired by "delete_volume" :: waited 0.018s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:44:24 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fac668-9c05-40aa-82f4-73fbd8faa255]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:44:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ba47fc89-5773-4409-98f6-e64ff13d6e0a tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:24 devstack sudo[103846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44 Nov 02 15:44:24 devstack sudo[103846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:24 devstack sudo[103846]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ba47fc89-5773-4409-98f6-e64ff13d6e0a tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44" returned: 0 in 0.440s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ba47fc89-5773-4409-98f6-e64ff13d6e0a tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:24 devstack sudo[103852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44 Nov 02 15:44:24 devstack sudo[103852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:24 devstack sudo[103852]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ba47fc89-5773-4409-98f6-e64ff13d6e0a tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e01930c6-6dda-42f2-8bc8-3c4a74896a44" returned: 0 in 0.294s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:24 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ba47fc89-5773-4409-98f6-e64ff13d6e0a tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-quobyte-e01930c6-6dda-42f2-8bc8-3c4a74896a44" released by "delete_volume" :: held 0.814s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:44:25 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-ba47fc89-5773-4409-98f6-e64ff13d6e0a tempest-VolumesSnapshotTestJSON-1655319342 None] Created reservations ['1013a108-adf2-467c-b464-f5fc03175f4f', 'fe1504e0-5e3d-4895-a0b2-22dca9b627e5', 'a3d16f24-cd97-4b0e-9717-357fc6cf92da', '6d663395-c40b-4407-bc09-138567e5c50e'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:44:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ba47fc89-5773-4409-98f6-e64ff13d6e0a tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:44:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ba47fc89-5773-4409-98f6-e64ff13d6e0a tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:44:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ba47fc89-5773-4409-98f6-e64ff13d6e0a tempest-VolumesSnapshotTestJSON-1655319342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:44:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ba47fc89-5773-4409-98f6-e64ff13d6e0a tempest-VolumesSnapshotTestJSON-1655319342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:44:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ba47fc89-5773-4409-98f6-e64ff13d6e0a tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:44:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ba47fc89-5773-4409-98f6-e64ff13d6e0a tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:25 devstack sudo[103855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:44:25 devstack sudo[103855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:25 devstack sudo[103855]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ba47fc89-5773-4409-98f6-e64ff13d6e0a tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.321s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:25 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-ba47fc89-5773-4409-98f6-e64ff13d6e0a tempest-VolumesSnapshotTestJSON-1655319342 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:44:25 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-ba47fc89-5773-4409-98f6-e64ff13d6e0a tempest-VolumesSnapshotTestJSON-1655319342 None] Deleted volume successfully. Nov 02 15:44:25 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ba47fc89-5773-4409-98f6-e64ff13d6e0a tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-e01930c6-6dda-42f2-8bc8-3c4a74896a44-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:44:25 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:44:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] Flow 'volume_create_manager' (eff8559f-394e-4676-86a4-2e13678917e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:44:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09f88dc3-820d-472c-a1b5-da5ceb795d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:44:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09f88dc3-820d-472c-a1b5-da5ceb795d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-871981258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91380a2e-e127-486c-9327-0f45897c3b55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='551fd347ecd44eb99c9a6d34709b8339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:44:26Z,use_quota=True,user_id='c3572d47d42942828dbbe784882a32bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:44:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (181d1caa-ade9-4cd7-bbe2-a6325ef006cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:44:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (181d1caa-ade9-4cd7-bbe2-a6325ef006cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:44:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd93d76a-e38a-4713-9cf9-a7d24a9ca7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:44:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd93d76a-e38a-4713-9cf9-a7d24a9ca7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91380a2e-e127-486c-9327-0f45897c3b55', 'volume_name': 'volume-91380a2e-e127-486c-9327-0f45897c3b55', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:44:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dafe8bba-9797-4fb9-9301-38fc7d6f6fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:44:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dafe8bba-9797-4fb9-9301-38fc7d6f6fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:44:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34b7931b-9861-4aa8-a16d-2df4f78b2855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:44:26 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] Volume 91380a2e-e127-486c-9327-0f45897c3b55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91380a2e-e127-486c-9327-0f45897c3b55', 'volume_size': 1} Nov 02 15:44:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:44:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:44:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:44:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-871981258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91380a2e-e127-486c-9327-0f45897c3b55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='551fd347ecd44eb99c9a6d34709b8339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:44:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:44:26Z,use_quota=True,user_id='c3572d47d42942828dbbe784882a32bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:44:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] Creating volume 91380a2e-e127-486c-9327-0f45897c3b55 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:44:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:44:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:44:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:44:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:44:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:44:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:44:26 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:44:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:26 devstack sudo[103860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55 1073741824 Nov 02 15:44:26 devstack sudo[103860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:26 devstack sudo[103860]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55 1073741824" returned: 0 in 0.519s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:26 devstack sudo[103866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55 Nov 02 15:44:26 devstack sudo[103866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:26 devstack sudo[103866]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55" returned: 0 in 0.320s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:44:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:44:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34b7931b-9861-4aa8-a16d-2df4f78b2855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91380a2e-e127-486c-9327-0f45897c3b55', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:44:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d78a028-34bc-4e5f-b9d5-246c55c278ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:44:27 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] Volume volume-91380a2e-e127-486c-9327-0f45897c3b55 (91380a2e-e127-486c-9327-0f45897c3b55): created successfully Nov 02 15:44:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d78a028-34bc-4e5f-b9d5-246c55c278ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:44:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] Flow 'volume_create_manager' (eff8559f-394e-4676-86a4-2e13678917e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:44:27 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-d968d63e-748c-4a13-883c-ef194a2a381a tempest-VolumesSnapshotTestJSON-1655319342 None] Created volume successfully. Nov 02 15:44:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-526a20b2-33cc-42c4-b79a-32b5549c6083 tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:44:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-526a20b2-33cc-42c4-b79a-32b5549c6083 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:44:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-526a20b2-33cc-42c4-b79a-32b5549c6083 tempest-VolumesSnapshotTestJSON-1655319342 None] Creating offline snapshot de109773-89e6-42a0-9b19-c1260a27a716 of volume 91380a2e-e127-486c-9327-0f45897c3b55 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:44:28 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d522eef1-dd91-4f87-b4be-1da4e48b286c]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:44:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-526a20b2-33cc-42c4-b79a-32b5549c6083 tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:28 devstack sudo[103869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55 Nov 02 15:44:28 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:28 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-526a20b2-33cc-42c4-b79a-32b5549c6083 tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55" returned: 0 in 0.371s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-526a20b2-33cc-42c4-b79a-32b5549c6083 tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55.de109773-89e6-42a0-9b19-c1260a27a716 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:28 devstack sudo[103900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55.de109773-89e6-42a0-9b19-c1260a27a716 1G Nov 02 15:44:28 devstack sudo[103900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:29 devstack sudo[103900]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-526a20b2-33cc-42c4-b79a-32b5549c6083 tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55.de109773-89e6-42a0-9b19-c1260a27a716 1G" returned: 0 in 0.482s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-526a20b2-33cc-42c4-b79a-32b5549c6083 tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91380a2e-e127-486c-9327-0f45897c3b55 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55.de109773-89e6-42a0-9b19-c1260a27a716 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:29 devstack sudo[103915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91380a2e-e127-486c-9327-0f45897c3b55 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55.de109773-89e6-42a0-9b19-c1260a27a716 Nov 02 15:44:29 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:29 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-526a20b2-33cc-42c4-b79a-32b5549c6083 tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91380a2e-e127-486c-9327-0f45897c3b55 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55.de109773-89e6-42a0-9b19-c1260a27a716" returned: 0 in 0.330s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:29 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-526a20b2-33cc-42c4-b79a-32b5549c6083 tempest-VolumesSnapshotTestJSON-1655319342 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55.de109773-89e6-42a0-9b19-c1260a27a716 is being set with open permissions: ugo+rw Nov 02 15:44:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-526a20b2-33cc-42c4-b79a-32b5549c6083 tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55.de109773-89e6-42a0-9b19-c1260a27a716 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:29 devstack sudo[103920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55.de109773-89e6-42a0-9b19-c1260a27a716 Nov 02 15:44:29 devstack sudo[103920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:29 devstack sudo[103920]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-526a20b2-33cc-42c4-b79a-32b5549c6083 tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55.de109773-89e6-42a0-9b19-c1260a27a716" returned: 0 in 0.256s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-526a20b2-33cc-42c4-b79a-32b5549c6083 tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:29 devstack sudo[103923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55.info Nov 02 15:44:29 devstack sudo[103923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:30 devstack sudo[103923]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-526a20b2-33cc-42c4-b79a-32b5549c6083 tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55.info" returned: 0 in 0.253s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:30 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-526a20b2-33cc-42c4-b79a-32b5549c6083 tempest-VolumesSnapshotTestJSON-1655319342 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55.info is being set with open permissions: ugo+rw Nov 02 15:44:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-526a20b2-33cc-42c4-b79a-32b5549c6083 tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:30 devstack sudo[103926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55.info Nov 02 15:44:30 devstack sudo[103926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:30 devstack sudo[103926]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-526a20b2-33cc-42c4-b79a-32b5549c6083 tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55.info" returned: 0 in 0.252s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-526a20b2-33cc-42c4-b79a-32b5549c6083 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.039s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:44:30 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-526a20b2-33cc-42c4-b79a-32b5549c6083 tempest-VolumesSnapshotTestJSON-1655319342 None] Create snapshot completed successfully Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Flow 'volume_create_manager' (fc4b88c4-26b4-4c21-bc95-f71d7ea05798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc729446-9506-4716-9a2a-d732588b2dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc729446-9506-4716-9a2a-d732588b2dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1817811043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='551fd347ecd44eb99c9a6d34709b8339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:44:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=de109773-89e6-42a0-9b19-c1260a27a716,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:44:32Z,use_quota=True,user_id='c3572d47d42942828dbbe784882a32bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b53f9b17-4559-49a5-af20-111f72208e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b53f9b17-4559-49a5-af20-111f72208e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc3fffe0-becd-48e4-9e66-d9df4b38801b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc3fffe0-becd-48e4-9e66-d9df4b38801b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3', 'volume_name': 'volume-0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3', 'volume_size': 1, 'snapshot_id': 'de109773-89e6-42a0-9b19-c1260a27a716'}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa8ddd4-7440-424a-a6e9-79004fccb553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa8ddd4-7440-424a-a6e9-79004fccb553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (228f877b-4ed5-4ad4-8a0f-c48e658c851a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:44:32 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Volume 0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3', 'volume_size': 1, 'snapshot_id': 'de109773-89e6-42a0-9b19-c1260a27a716'} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "cinder-quobyte-de109773-89e6-42a0-9b19-c1260a27a716-0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3" by "_create_volume_from_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-quobyte-de109773-89e6-42a0-9b19-c1260a27a716-0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Creating volume 0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3 from snapshot de109773-89e6-42a0-9b19-c1260a27a716 {{(pid=86703) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "cinder-quobyte-0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3" by "_copy_volume_from_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-quobyte-0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] snapshot: de109773-89e6-42a0-9b19-c1260a27a716, volume: 0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3, {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[555c6c62-e827-4048-b072-63213a1a08c3]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55.de109773-89e6-42a0-9b19-c1260a27a716 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:32 devstack sudo[103929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55.de109773-89e6-42a0-9b19-c1260a27a716 Nov 02 15:44:32 devstack sudo[103929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:32 devstack sudo[103929]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55.de109773-89e6-42a0-9b19-c1260a27a716" returned: 0 in 0.379s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91380a2e-e127-486c-9327-0f45897c3b55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11981dc-d609-4695-9bb5-e341b2b5644d]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:32 devstack sudo[103934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55 Nov 02 15:44:32 devstack sudo[103934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:32 devstack sudo[103934]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55" returned: 0 in 0.385s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] will copy from snapshot at /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55 {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Creating direct copy from snapshot {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 15:44:32 devstack cinder-volume[86703]: DEBUG cinder.utils [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Path /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3 not found in is_blk_device check {{(pid=86703) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 15:44:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:33 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3 Nov 02 15:44:33 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:39 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3" returned: 0 in 6.592s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:39 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Image conversion details: src /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55, size 1024.00 MB, duration 6.59 sec, destination /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3 {{(pid=86703) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 15:44:39 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Converted 1024.00 MB image at 155.31 MB/s Nov 02 15:44:39 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3 is being set with open permissions: ugo+rw Nov 02 15:44:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:39 devstack sudo[103953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3 Nov 02 15:44:39 devstack sudo[103953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:39 devstack sudo[103953]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3" returned: 0 in 0.247s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-quobyte-0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3" released by "_copy_volume_from_snapshot" :: held 7.689s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:44:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-quobyte-de109773-89e6-42a0-9b19-c1260a27a716-0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3" released by "_create_volume_from_snapshot" :: held 7.751s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:44:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.766s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:44:39 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (228f877b-4ed5-4ad4-8a0f-c48e658c851a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3', 'volume_size': 1, 'snapshot_id': 'de109773-89e6-42a0-9b19-c1260a27a716'}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:44:39 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (235288a3-0bc7-429a-b007-be77c16182f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:44:39 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Volume volume-0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3 (0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3): created successfully Nov 02 15:44:39 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (235288a3-0bc7-429a-b007-be77c16182f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:44:39 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Flow 'volume_create_manager' (fc4b88c4-26b4-4c21-bc95-f71d7ea05798) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:44:39 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-27cd5190-cfd4-4a02-b120-9ddc79fc817a tempest-VolumesSnapshotTestJSON-1655319342 None] Created volume successfully. Nov 02 15:44:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-70b3b8d5-d02c-4927-9197-dd179426e24e tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "cinder-0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:44:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-70b3b8d5-d02c-4927-9197-dd179426e24e tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:44:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-70b3b8d5-d02c-4927-9197-dd179426e24e tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "cinder-quobyte-0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:44:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-70b3b8d5-d02c-4927-9197-dd179426e24e tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-quobyte-0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3" acquired by "delete_volume" :: waited 0.018s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:44:40 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2183b9-2410-4f1f-88cb-fe21daeca1c7]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:44:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-70b3b8d5-d02c-4927-9197-dd179426e24e tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:40 devstack sudo[103956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3 Nov 02 15:44:40 devstack sudo[103956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:41 devstack sudo[103956]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-70b3b8d5-d02c-4927-9197-dd179426e24e tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3" returned: 0 in 0.346s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-70b3b8d5-d02c-4927-9197-dd179426e24e tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:41 devstack sudo[103961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3 Nov 02 15:44:41 devstack sudo[103961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:41 devstack sudo[103961]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-70b3b8d5-d02c-4927-9197-dd179426e24e tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3" returned: 0 in 0.238s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:41 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-70b3b8d5-d02c-4927-9197-dd179426e24e tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-quobyte-0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3" released by "delete_volume" :: held 0.627s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:44:41 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-70b3b8d5-d02c-4927-9197-dd179426e24e tempest-VolumesSnapshotTestJSON-1655319342 None] Created reservations ['f498ba82-8867-4dce-895d-177cab9fa47e', '88608303-6ccb-4eff-83a9-5df769d50390', '0402c5c0-c647-4b9d-84fc-bd33ce1ca9bf', 'f1041d8c-02c0-42c8-9623-40590fdba419'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:44:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-70b3b8d5-d02c-4927-9197-dd179426e24e tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:44:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-70b3b8d5-d02c-4927-9197-dd179426e24e tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:44:41 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-70b3b8d5-d02c-4927-9197-dd179426e24e tempest-VolumesSnapshotTestJSON-1655319342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:44:41 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-70b3b8d5-d02c-4927-9197-dd179426e24e tempest-VolumesSnapshotTestJSON-1655319342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:44:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-70b3b8d5-d02c-4927-9197-dd179426e24e tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:44:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-70b3b8d5-d02c-4927-9197-dd179426e24e tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:41 devstack sudo[103964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:44:41 devstack sudo[103964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:41 devstack sudo[103964]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-70b3b8d5-d02c-4927-9197-dd179426e24e tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.236s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:41 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-70b3b8d5-d02c-4927-9197-dd179426e24e tempest-VolumesSnapshotTestJSON-1655319342 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:44:41 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-70b3b8d5-d02c-4927-9197-dd179426e24e tempest-VolumesSnapshotTestJSON-1655319342 None] Deleted volume successfully. Nov 02 15:44:41 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-70b3b8d5-d02c-4927-9197-dd179426e24e tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-0fdc9ae3-fe19-464e-a8a1-3f64af34a1e3-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:44:41 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c48e3b91-980d-46be-a746-bfcc4b03f2a6 tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "cinder-de109773-89e6-42a0-9b19-c1260a27a716-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:44:42 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c48e3b91-980d-46be-a746-bfcc4b03f2a6 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-de109773-89e6-42a0-9b19-c1260a27a716-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:44:42 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c48e3b91-980d-46be-a746-bfcc4b03f2a6 tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "cinder-quobyte-91380a2e-e127-486c-9327-0f45897c3b55" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:44:42 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c48e3b91-980d-46be-a746-bfcc4b03f2a6 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-quobyte-91380a2e-e127-486c-9327-0f45897c3b55" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:44:42 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c48e3b91-980d-46be-a746-bfcc4b03f2a6 tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "cinder-quobyte-de109773-89e6-42a0-9b19-c1260a27a716" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:44:42 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c48e3b91-980d-46be-a746-bfcc4b03f2a6 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-quobyte-de109773-89e6-42a0-9b19-c1260a27a716" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:44:42 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-c48e3b91-980d-46be-a746-bfcc4b03f2a6 tempest-VolumesSnapshotTestJSON-1655319342 None] Deleting offline snapshot de109773-89e6-42a0-9b19-c1260a27a716 of volume 91380a2e-e127-486c-9327-0f45897c3b55 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:44:42 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-c48e3b91-980d-46be-a746-bfcc4b03f2a6 tempest-VolumesSnapshotTestJSON-1655319342 None] snapshot_file for this snap is: volume-91380a2e-e127-486c-9327-0f45897c3b55.de109773-89e6-42a0-9b19-c1260a27a716 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:44:42 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb9a172-8497-4085-becb-04fda3ca5b5d]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:44:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c48e3b91-980d-46be-a746-bfcc4b03f2a6 tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55.de109773-89e6-42a0-9b19-c1260a27a716 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:42 devstack sudo[103967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55.de109773-89e6-42a0-9b19-c1260a27a716 Nov 02 15:44:42 devstack sudo[103967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:42 devstack sudo[103967]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c48e3b91-980d-46be-a746-bfcc4b03f2a6 tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55.de109773-89e6-42a0-9b19-c1260a27a716" returned: 0 in 0.349s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:42 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-c48e3b91-980d-46be-a746-bfcc4b03f2a6 tempest-VolumesSnapshotTestJSON-1655319342 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91380a2e-e127-486c-9327-0f45897c3b55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:44:42 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[240561e7-c209-4cd3-9ba5-169b4dc7ca17]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:44:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c48e3b91-980d-46be-a746-bfcc4b03f2a6 tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:42 devstack sudo[103972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55 Nov 02 15:44:42 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:42 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c48e3b91-980d-46be-a746-bfcc4b03f2a6 tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55" returned: 0 in 0.531s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c48e3b91-980d-46be-a746-bfcc4b03f2a6 tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55.de109773-89e6-42a0-9b19-c1260a27a716 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:43 devstack sudo[103978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55.de109773-89e6-42a0-9b19-c1260a27a716 Nov 02 15:44:43 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:43 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c48e3b91-980d-46be-a746-bfcc4b03f2a6 tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55.de109773-89e6-42a0-9b19-c1260a27a716" returned: 0 in 0.332s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c48e3b91-980d-46be-a746-bfcc4b03f2a6 tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55.de109773-89e6-42a0-9b19-c1260a27a716 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:43 devstack sudo[103984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55.de109773-89e6-42a0-9b19-c1260a27a716 Nov 02 15:44:43 devstack sudo[103984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:43 devstack sudo[103984]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c48e3b91-980d-46be-a746-bfcc4b03f2a6 tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55.de109773-89e6-42a0-9b19-c1260a27a716" returned: 0 in 0.239s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:43 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c48e3b91-980d-46be-a746-bfcc4b03f2a6 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-quobyte-de109773-89e6-42a0-9b19-c1260a27a716" released by "_delete_snapshot" :: held 1.555s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:44:43 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c48e3b91-980d-46be-a746-bfcc4b03f2a6 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-quobyte-91380a2e-e127-486c-9327-0f45897c3b55" released by "delete_snapshot" :: held 1.577s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:44:43 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-c48e3b91-980d-46be-a746-bfcc4b03f2a6 tempest-VolumesSnapshotTestJSON-1655319342 None] Created reservations ['d21bba7b-4f09-4034-b23b-bf4d0aeb60c4', '1d05050f-b1c4-4b2a-b6e8-4e095a3ce40d', '32494bd6-3666-486b-a692-e573de8e868e', 'faa3fc10-f37d-498e-b346-475ce2d4e5af'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:44:43 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-c48e3b91-980d-46be-a746-bfcc4b03f2a6 tempest-VolumesSnapshotTestJSON-1655319342 None] Delete snapshot completed successfully. Nov 02 15:44:43 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c48e3b91-980d-46be-a746-bfcc4b03f2a6 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-de109773-89e6-42a0-9b19-c1260a27a716-delete_snapshot" released by "delete_snapshot" :: held 1.699s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:44:44 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d9e83d85-3943-4a47-962d-0a8a1125b1b6 tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "cinder-91380a2e-e127-486c-9327-0f45897c3b55-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:44:44 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d9e83d85-3943-4a47-962d-0a8a1125b1b6 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-91380a2e-e127-486c-9327-0f45897c3b55-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:44:44 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d9e83d85-3943-4a47-962d-0a8a1125b1b6 tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "cinder-quobyte-91380a2e-e127-486c-9327-0f45897c3b55" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:44:44 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d9e83d85-3943-4a47-962d-0a8a1125b1b6 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-quobyte-91380a2e-e127-486c-9327-0f45897c3b55" acquired by "delete_volume" :: waited 0.017s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:44:44 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2947909b-3576-4237-a1b2-591d8de080d4]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:44:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d9e83d85-3943-4a47-962d-0a8a1125b1b6 tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:44 devstack sudo[103987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55 Nov 02 15:44:44 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:44 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d9e83d85-3943-4a47-962d-0a8a1125b1b6 tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55" returned: 0 in 0.383s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d9e83d85-3943-4a47-962d-0a8a1125b1b6 tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:44 devstack sudo[103992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55 Nov 02 15:44:44 devstack sudo[103992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:44 devstack sudo[103992]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d9e83d85-3943-4a47-962d-0a8a1125b1b6 tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-91380a2e-e127-486c-9327-0f45897c3b55" returned: 0 in 0.236s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:44 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d9e83d85-3943-4a47-962d-0a8a1125b1b6 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-quobyte-91380a2e-e127-486c-9327-0f45897c3b55" released by "delete_volume" :: held 0.680s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:44:45 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-d9e83d85-3943-4a47-962d-0a8a1125b1b6 tempest-VolumesSnapshotTestJSON-1655319342 None] Created reservations ['0927d1aa-a970-451a-b0b2-f1c45c4d54ca', 'b10cfa08-f678-4394-93ec-96161d6291c4', '9ade1878-ecef-440e-bb41-6ab69f1ad50d', 'a28e3443-f2e3-4c38-aa8f-e5c1c403f4d9'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:44:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d9e83d85-3943-4a47-962d-0a8a1125b1b6 tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:44:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d9e83d85-3943-4a47-962d-0a8a1125b1b6 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:44:45 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d9e83d85-3943-4a47-962d-0a8a1125b1b6 tempest-VolumesSnapshotTestJSON-1655319342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:44:45 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d9e83d85-3943-4a47-962d-0a8a1125b1b6 tempest-VolumesSnapshotTestJSON-1655319342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:44:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d9e83d85-3943-4a47-962d-0a8a1125b1b6 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:44:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d9e83d85-3943-4a47-962d-0a8a1125b1b6 tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:45 devstack sudo[103995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:44:45 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:45 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d9e83d85-3943-4a47-962d-0a8a1125b1b6 tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.242s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:45 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-d9e83d85-3943-4a47-962d-0a8a1125b1b6 tempest-VolumesSnapshotTestJSON-1655319342 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:44:45 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-d9e83d85-3943-4a47-962d-0a8a1125b1b6 tempest-VolumesSnapshotTestJSON-1655319342 None] Deleted volume successfully. Nov 02 15:44:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d9e83d85-3943-4a47-962d-0a8a1125b1b6 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-91380a2e-e127-486c-9327-0f45897c3b55-delete_volume" released by "delete_volume" :: held 1.130s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:44:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5b26b6bc-cddb-4b0e-8865-93899502ce05 tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "cinder-b77273a0-b4bb-4d28-a576-f2393f97e238-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:44:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5b26b6bc-cddb-4b0e-8865-93899502ce05 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-b77273a0-b4bb-4d28-a576-f2393f97e238-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:44:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5b26b6bc-cddb-4b0e-8865-93899502ce05 tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "cinder-quobyte-b77273a0-b4bb-4d28-a576-f2393f97e238" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:44:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5b26b6bc-cddb-4b0e-8865-93899502ce05 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-quobyte-b77273a0-b4bb-4d28-a576-f2393f97e238" acquired by "delete_volume" :: waited 0.019s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:44:45 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[657be8e4-7848-40b5-83a8-92a9cb72af14]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:44:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5b26b6bc-cddb-4b0e-8865-93899502ce05 tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:45 devstack sudo[103998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238 Nov 02 15:44:45 devstack sudo[103998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:45 devstack sudo[103998]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5b26b6bc-cddb-4b0e-8865-93899502ce05 tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238" returned: 0 in 0.367s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5b26b6bc-cddb-4b0e-8865-93899502ce05 tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:45 devstack sudo[104006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238 Nov 02 15:44:45 devstack sudo[104006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:46 devstack sudo[104006]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5b26b6bc-cddb-4b0e-8865-93899502ce05 tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b77273a0-b4bb-4d28-a576-f2393f97e238" returned: 0 in 0.254s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:46 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5b26b6bc-cddb-4b0e-8865-93899502ce05 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-quobyte-b77273a0-b4bb-4d28-a576-f2393f97e238" released by "delete_volume" :: held 0.686s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:44:46 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-5b26b6bc-cddb-4b0e-8865-93899502ce05 tempest-VolumesSnapshotTestJSON-1655319342 None] Created reservations ['f56f95f0-3d09-4bb2-88dd-0e378ea44dc9', 'e47772eb-44d9-4551-9ca3-ce6b392d1c84', '33464b3f-36ed-4b65-aba4-68bd47ce8cee', '28e6ed64-0288-49c8-85eb-1de1e5d0c23d'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:44:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5b26b6bc-cddb-4b0e-8865-93899502ce05 tempest-VolumesSnapshotTestJSON-1655319342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:44:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5b26b6bc-cddb-4b0e-8865-93899502ce05 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:44:46 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-5b26b6bc-cddb-4b0e-8865-93899502ce05 tempest-VolumesSnapshotTestJSON-1655319342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:44:46 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-5b26b6bc-cddb-4b0e-8865-93899502ce05 tempest-VolumesSnapshotTestJSON-1655319342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:44:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5b26b6bc-cddb-4b0e-8865-93899502ce05 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:44:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5b26b6bc-cddb-4b0e-8865-93899502ce05 tempest-VolumesSnapshotTestJSON-1655319342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:46 devstack sudo[104009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:44:46 devstack sudo[104009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:46 devstack sudo[104009]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5b26b6bc-cddb-4b0e-8865-93899502ce05 tempest-VolumesSnapshotTestJSON-1655319342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.262s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:46 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-5b26b6bc-cddb-4b0e-8865-93899502ce05 tempest-VolumesSnapshotTestJSON-1655319342 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:44:46 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-5b26b6bc-cddb-4b0e-8865-93899502ce05 tempest-VolumesSnapshotTestJSON-1655319342 None] Deleted volume successfully. Nov 02 15:44:46 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5b26b6bc-cddb-4b0e-8865-93899502ce05 tempest-VolumesSnapshotTestJSON-1655319342 None] Lock "cinder-b77273a0-b4bb-4d28-a576-f2393f97e238-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:44:52 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-7f128b17-81db-48d8-9f2f-6dcf86658a5d req-5ff7e7e0-4edf-4f7f-88c4-a8bc9430ca6b tempest-TestShelveInstance-1430468173 None] Terminate volume connection completed successfully. Nov 02 15:44:52 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-7f128b17-81db-48d8-9f2f-6dcf86658a5d req-5ff7e7e0-4edf-4f7f-88c4-a8bc9430ca6b tempest-TestShelveInstance-1430468173 None] Deleting attachment 0bdd8b6d-2896-49b0-b8b1-8de8c4da2c80. {{(pid=86703) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 15:44:52 devstack cinder-volume[86703]: DEBUG cinder.coordination [req-7f128b17-81db-48d8-9f2f-6dcf86658a5d req-73e3ab79-3455-4c39-bfdd-cb01bbc5bff6 tempest-TestShelveInstance-1430468173 None] Acquiring lock "cinder-ba3c99cc-5784-4c45-97fa-241790a249d8-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:44:52 devstack cinder-volume[86703]: DEBUG cinder.coordination [req-7f128b17-81db-48d8-9f2f-6dcf86658a5d req-73e3ab79-3455-4c39-bfdd-cb01bbc5bff6 tempest-TestShelveInstance-1430468173 None] Lock "cinder-ba3c99cc-5784-4c45-97fa-241790a249d8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:44:52 devstack cinder-volume[86703]: DEBUG cinder.coordination [req-7f128b17-81db-48d8-9f2f-6dcf86658a5d req-73e3ab79-3455-4c39-bfdd-cb01bbc5bff6 tempest-TestShelveInstance-1430468173 None] Acquiring lock "cinder-quobyte-ba3c99cc-5784-4c45-97fa-241790a249d8" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:44:52 devstack cinder-volume[86703]: DEBUG cinder.coordination [req-7f128b17-81db-48d8-9f2f-6dcf86658a5d req-73e3ab79-3455-4c39-bfdd-cb01bbc5bff6 tempest-TestShelveInstance-1430468173 None] Lock "cinder-quobyte-ba3c99cc-5784-4c45-97fa-241790a249d8" acquired by "delete_volume" :: waited 0.020s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:44:52 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1433447a-3844-403d-9e6e-15c253a93672]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:44:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-7f128b17-81db-48d8-9f2f-6dcf86658a5d req-73e3ab79-3455-4c39-bfdd-cb01bbc5bff6 tempest-TestShelveInstance-1430468173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ba3c99cc-5784-4c45-97fa-241790a249d8 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:52 devstack sudo[104043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ba3c99cc-5784-4c45-97fa-241790a249d8 Nov 02 15:44:52 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:52 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-7f128b17-81db-48d8-9f2f-6dcf86658a5d req-73e3ab79-3455-4c39-bfdd-cb01bbc5bff6 tempest-TestShelveInstance-1430468173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ba3c99cc-5784-4c45-97fa-241790a249d8" returned: 0 in 0.439s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-7f128b17-81db-48d8-9f2f-6dcf86658a5d req-73e3ab79-3455-4c39-bfdd-cb01bbc5bff6 tempest-TestShelveInstance-1430468173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ba3c99cc-5784-4c45-97fa-241790a249d8 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:52 devstack sudo[104048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ba3c99cc-5784-4c45-97fa-241790a249d8 Nov 02 15:44:52 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:53 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-7f128b17-81db-48d8-9f2f-6dcf86658a5d req-73e3ab79-3455-4c39-bfdd-cb01bbc5bff6 tempest-TestShelveInstance-1430468173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ba3c99cc-5784-4c45-97fa-241790a249d8" returned: 0 in 0.281s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:53 devstack cinder-volume[86703]: DEBUG cinder.coordination [req-7f128b17-81db-48d8-9f2f-6dcf86658a5d req-73e3ab79-3455-4c39-bfdd-cb01bbc5bff6 tempest-TestShelveInstance-1430468173 None] Lock "cinder-quobyte-ba3c99cc-5784-4c45-97fa-241790a249d8" released by "delete_volume" :: held 0.779s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:44:53 devstack cinder-volume[86703]: DEBUG cinder.quota [req-7f128b17-81db-48d8-9f2f-6dcf86658a5d req-73e3ab79-3455-4c39-bfdd-cb01bbc5bff6 tempest-TestShelveInstance-1430468173 None] Created reservations ['82350bb4-ca2a-4e3a-9a27-c97e81cabae8', '40bfd2f3-ca0a-48c8-b57d-a43821e28766', '0e1a65e7-0dc8-40b8-b225-f47491916fd5', '72ad1a63-420a-49cf-82ee-1a5530bd2f3d'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:44:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-7f128b17-81db-48d8-9f2f-6dcf86658a5d req-73e3ab79-3455-4c39-bfdd-cb01bbc5bff6 tempest-TestShelveInstance-1430468173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:44:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-7f128b17-81db-48d8-9f2f-6dcf86658a5d req-73e3ab79-3455-4c39-bfdd-cb01bbc5bff6 tempest-TestShelveInstance-1430468173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:44:53 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [req-7f128b17-81db-48d8-9f2f-6dcf86658a5d req-73e3ab79-3455-4c39-bfdd-cb01bbc5bff6 tempest-TestShelveInstance-1430468173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:44:53 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [req-7f128b17-81db-48d8-9f2f-6dcf86658a5d req-73e3ab79-3455-4c39-bfdd-cb01bbc5bff6 tempest-TestShelveInstance-1430468173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:44:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-7f128b17-81db-48d8-9f2f-6dcf86658a5d req-73e3ab79-3455-4c39-bfdd-cb01bbc5bff6 tempest-TestShelveInstance-1430468173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:44:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-7f128b17-81db-48d8-9f2f-6dcf86658a5d req-73e3ab79-3455-4c39-bfdd-cb01bbc5bff6 tempest-TestShelveInstance-1430468173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:44:53 devstack sudo[104051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:44:53 devstack sudo[104051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:44:53 devstack sudo[104051]: pam_unix(sudo:session): session closed for user root Nov 02 15:44:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [req-7f128b17-81db-48d8-9f2f-6dcf86658a5d req-73e3ab79-3455-4c39-bfdd-cb01bbc5bff6 tempest-TestShelveInstance-1430468173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.320s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:44:53 devstack cinder-volume[86703]: DEBUG cinder.manager [req-7f128b17-81db-48d8-9f2f-6dcf86658a5d req-73e3ab79-3455-4c39-bfdd-cb01bbc5bff6 tempest-TestShelveInstance-1430468173 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:44:53 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-7f128b17-81db-48d8-9f2f-6dcf86658a5d req-73e3ab79-3455-4c39-bfdd-cb01bbc5bff6 tempest-TestShelveInstance-1430468173 None] Deleted volume successfully. Nov 02 15:44:53 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:DELETE=11,cinder:UPDATE=101,cinder:SELECT=88,cinder:INSERT=25 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:44:53 devstack cinder-volume[86703]: DEBUG cinder.coordination [req-7f128b17-81db-48d8-9f2f-6dcf86658a5d req-73e3ab79-3455-4c39-bfdd-cb01bbc5bff6 tempest-TestShelveInstance-1430468173 None] Lock "cinder-ba3c99cc-5784-4c45-97fa-241790a249d8-delete_volume" released by "delete_volume" :: held 1.349s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:45:03 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=84,cinder:UPDATE=99,cinder:DELETE=5,cinder:INSERT=26 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:45:10 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:45:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] Flow 'volume_create_manager' (67dcaeb2-1d98-4335-a7f1-9cae657c0dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:45:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fc04258-8ffa-4d83-b846-85fe95ad33a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fc04258-8ffa-4d83-b846-85fe95ad33a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1219993782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=717d5d0d-f611-42e7-b239-9209cf6070c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb35bc5633a49429449f9e5d49153a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:45:11Z,use_quota=True,user_id='3038e840f81441ef8df251df5b843daf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b56e3ff-b378-44d8-b4a0-79567e992489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b56e3ff-b378-44d8-b4a0-79567e992489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (083d20f1-87be-43f9-af8e-0d3fe0c709fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (083d20f1-87be-43f9-af8e-0d3fe0c709fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '717d5d0d-f611-42e7-b239-9209cf6070c1', 'volume_name': 'volume-717d5d0d-f611-42e7-b239-9209cf6070c1', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4f3a21f-dab5-4276-b27d-3a19121d7438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4f3a21f-dab5-4276-b27d-3a19121d7438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d3be19-ec9e-414a-99b6-d0563a7f6678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:10 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] Volume 717d5d0d-f611-42e7-b239-9209cf6070c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-717d5d0d-f611-42e7-b239-9209cf6070c1', 'volume_size': 1} Nov 02 15:45:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:45:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:45:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:45:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1219993782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=717d5d0d-f611-42e7-b239-9209cf6070c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb35bc5633a49429449f9e5d49153a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:45:11Z,use_quota=True,user_id='3038e840f81441ef8df251df5b843daf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:45:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] Creating volume 717d5d0d-f611-42e7-b239-9209cf6070c1 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:45:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:45:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:45:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:45:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:45:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:45:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:45:10 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:45:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-717d5d0d-f611-42e7-b239-9209cf6070c1 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:10 devstack sudo[104105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-717d5d0d-f611-42e7-b239-9209cf6070c1 1073741824 Nov 02 15:45:10 devstack sudo[104105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] Flow 'volume_create_manager' (81621a51-8e34-4e45-b486-221eac9048bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (837d2ef5-7b1a-4bb3-81ea-091188e83ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (837d2ef5-7b1a-4bb3-81ea-091188e83ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1385025359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d91c1c-d835-48be-8930-66f169e76fba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb35bc5633a49429449f9e5d49153a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:45:11Z,use_quota=True,user_id='3038e840f81441ef8df251df5b843daf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda3aee6-4e30-464c-8152-ba2b25c2002f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dda3aee6-4e30-464c-8152-ba2b25c2002f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e325a05f-53ce-47d1-8418-60464b647fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e325a05f-53ce-47d1-8418-60464b647fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36d91c1c-d835-48be-8930-66f169e76fba', 'volume_name': 'volume-36d91c1c-d835-48be-8930-66f169e76fba', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (827405a3-0690-46de-8ff1-3403637152a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (827405a3-0690-46de-8ff1-3403637152a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7632ab-490b-4914-bdef-50f7c9ccc2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:11 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] Volume 36d91c1c-d835-48be-8930-66f169e76fba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36d91c1c-d835-48be-8930-66f169e76fba', 'volume_size': 1} Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:45:11 devstack sudo[104105]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-717d5d0d-f611-42e7-b239-9209cf6070c1 1073741824" returned: 0 in 0.678s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-717d5d0d-f611-42e7-b239-9209cf6070c1 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:11 devstack sudo[104111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-717d5d0d-f611-42e7-b239-9209cf6070c1 Nov 02 15:45:11 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] Flow 'volume_create_manager' (6ca9f004-de80-4a33-8510-f55fd0133238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dfb74e0-d8a1-450d-be89-050619255e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6dfb74e0-d8a1-450d-be89-050619255e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1478545641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce147816-04d0-4a8e-93bd-7c3d97911416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb35bc5633a49429449f9e5d49153a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:45:12Z,use_quota=True,user_id='3038e840f81441ef8df251df5b843daf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:11 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8803cc8-756f-4dd5-8556-993f0c782365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8803cc8-756f-4dd5-8556-993f0c782365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9fb430-bfbb-4b78-a5eb-cf775adb0484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b9fb430-bfbb-4b78-a5eb-cf775adb0484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce147816-04d0-4a8e-93bd-7c3d97911416', 'volume_name': 'volume-ce147816-04d0-4a8e-93bd-7c3d97911416', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d14716-8a0b-4d0d-b7eb-01c274677a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d14716-8a0b-4d0d-b7eb-01c274677a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c53f42-6de2-4909-96ba-971f184ce5b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:11 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] Volume ce147816-04d0-4a8e-93bd-7c3d97911416: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce147816-04d0-4a8e-93bd-7c3d97911416', 'volume_size': 1} Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-717d5d0d-f611-42e7-b239-9209cf6070c1" returned: 0 in 0.357s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.548s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1385025359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d91c1c-d835-48be-8930-66f169e76fba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb35bc5633a49429449f9e5d49153a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:45:11Z,use_quota=True,user_id='3038e840f81441ef8df251df5b843daf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] Creating volume 36d91c1c-d835-48be-8930-66f169e76fba {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:45:11 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:45:12 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-36d91c1c-d835-48be-8930-66f169e76fba 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1d3be19-ec9e-414a-99b6-d0563a7f6678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-717d5d0d-f611-42e7-b239-9209cf6070c1', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:12 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-36d91c1c-d835-48be-8930-66f169e76fba 1073741824 Nov 02 15:45:12 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42f5938a-1a01-4873-9240-4a1caff78024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:12 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] Volume volume-717d5d0d-f611-42e7-b239-9209cf6070c1 (717d5d0d-f611-42e7-b239-9209cf6070c1): created successfully Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42f5938a-1a01-4873-9240-4a1caff78024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] Flow 'volume_create_manager' (67dcaeb2-1d98-4335-a7f1-9cae657c0dad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:45:12 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-d8083e83-e469-493e-90ed-0df11fd74c18 tempest-CreateVolumesFromImageTest-911315106 None] Created volume successfully. Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] Flow 'volume_create_manager' (5ab984b9-a0ce-4d27-a8be-3f08296272dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c13facf-acef-4500-b958-742ee2dc9b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c13facf-acef-4500-b958-742ee2dc9b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:45:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-241956481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdaba118-e18c-4739-bdd3-b8ea1cd01c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb35bc5633a49429449f9e5d49153a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:45:12Z,use_quota=True,user_id='3038e840f81441ef8df251df5b843daf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d46da12-b80c-4b8f-8f7b-a74436ca657f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d46da12-b80c-4b8f-8f7b-a74436ca657f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f69aff0-4d85-4ca3-95b4-e1c5dd15c9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f69aff0-4d85-4ca3-95b4-e1c5dd15c9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdaba118-e18c-4739-bdd3-b8ea1cd01c40', 'volume_name': 'volume-bdaba118-e18c-4739-bdd3-b8ea1cd01c40', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459135ff-982b-4651-bf0d-76399b89b675) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (459135ff-982b-4651-bf0d-76399b89b675) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a1b0e1e-3ae0-4d36-b811-e63cdf88203f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:12 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] Volume bdaba118-e18c-4739-bdd3-b8ea1cd01c40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdaba118-e18c-4739-bdd3-b8ea1cd01c40', 'volume_size': 1} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:45:12 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-36d91c1c-d835-48be-8930-66f169e76fba 1073741824" returned: 0 in 0.640s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-36d91c1c-d835-48be-8930-66f169e76fba {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:12 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-36d91c1c-d835-48be-8930-66f169e76fba Nov 02 15:45:12 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] Flow 'volume_create_manager' (6421c5e5-cb48-47b9-8920-8f50573545b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e13f711-52fe-48c0-8316-43bcedbf88f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e13f711-52fe-48c0-8316-43bcedbf88f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:45:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-167397546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e63e4e1-42bd-4b64-abef-433246519654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb35bc5633a49429449f9e5d49153a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:45:13Z,use_quota=True,user_id='3038e840f81441ef8df251df5b843daf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ca50f31-b7e0-4ac2-b949-e2f46754f152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ca50f31-b7e0-4ac2-b949-e2f46754f152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be45f2d-3562-4516-9396-26670f75a8d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be45f2d-3562-4516-9396-26670f75a8d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e63e4e1-42bd-4b64-abef-433246519654', 'volume_name': 'volume-4e63e4e1-42bd-4b64-abef-433246519654', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bb8ff00-e0ce-497e-8460-393195a80b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bb8ff00-e0ce-497e-8460-393195a80b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5300494-d6d3-4366-821e-bbf34428fc21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:12 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] Volume 4e63e4e1-42bd-4b64-abef-433246519654: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e63e4e1-42bd-4b64-abef-433246519654', 'volume_size': 1} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:45:12 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-36d91c1c-d835-48be-8930-66f169e76fba" returned: 0 in 0.269s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.982s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1478545641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce147816-04d0-4a8e-93bd-7c3d97911416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb35bc5633a49429449f9e5d49153a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:45:12Z,use_quota=True,user_id='3038e840f81441ef8df251df5b843daf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] Creating volume ce147816-04d0-4a8e-93bd-7c3d97911416 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:45:12 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ce147816-04d0-4a8e-93bd-7c3d97911416 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d7632ab-490b-4914-bdef-50f7c9ccc2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36d91c1c-d835-48be-8930-66f169e76fba', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:12 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47d82b5-58eb-4d6a-9058-0681b26fb14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:12 devstack sudo[104123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ce147816-04d0-4a8e-93bd-7c3d97911416 1073741824 Nov 02 15:45:13 devstack sudo[104123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:13 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] Volume volume-36d91c1c-d835-48be-8930-66f169e76fba (36d91c1c-d835-48be-8930-66f169e76fba): created successfully Nov 02 15:45:13 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47d82b5-58eb-4d6a-9058-0681b26fb14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:13 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] Flow 'volume_create_manager' (81621a51-8e34-4e45-b486-221eac9048bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:45:13 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-d1d30c97-7eab-4413-a3ea-744118c5cebc tempest-CreateVolumesFromImageTest-911315106 None] Created volume successfully. Nov 02 15:45:13 devstack sudo[104123]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ce147816-04d0-4a8e-93bd-7c3d97911416 1073741824" returned: 0 in 0.448s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ce147816-04d0-4a8e-93bd-7c3d97911416 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:13 devstack sudo[104129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ce147816-04d0-4a8e-93bd-7c3d97911416 Nov 02 15:45:13 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:13 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ce147816-04d0-4a8e-93bd-7c3d97911416" returned: 0 in 0.307s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:13 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:45:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:45:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.395s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:45:13 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:45:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-241956481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdaba118-e18c-4739-bdd3-b8ea1cd01c40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb35bc5633a49429449f9e5d49153a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:45:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:45:12Z,use_quota=True,user_id='3038e840f81441ef8df251df5b843daf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:45:13 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] Creating volume bdaba118-e18c-4739-bdd3-b8ea1cd01c40 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:45:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:45:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:45:13 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:45:13 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:45:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:45:13 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:45:13 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:45:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bdaba118-e18c-4739-bdd3-b8ea1cd01c40 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:13 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c53f42-6de2-4909-96ba-971f184ce5b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce147816-04d0-4a8e-93bd-7c3d97911416', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:13 devstack sudo[104133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bdaba118-e18c-4739-bdd3-b8ea1cd01c40 1073741824 Nov 02 15:45:13 devstack sudo[104133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:13 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2060db46-3a06-444b-a60f-efae50f6c9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:13 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] Volume volume-ce147816-04d0-4a8e-93bd-7c3d97911416 (ce147816-04d0-4a8e-93bd-7c3d97911416): created successfully Nov 02 15:45:13 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2060db46-3a06-444b-a60f-efae50f6c9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:13 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] Flow 'volume_create_manager' (6ca9f004-de80-4a33-8510-f55fd0133238) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:45:13 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-787bf35d-c6c7-4ce5-b1e1-3c8c8bfc5a0f tempest-CreateVolumesFromImageTest-911315106 None] Created volume successfully. Nov 02 15:45:14 devstack sudo[104133]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bdaba118-e18c-4739-bdd3-b8ea1cd01c40 1073741824" returned: 0 in 0.514s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bdaba118-e18c-4739-bdd3-b8ea1cd01c40 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:14 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bdaba118-e18c-4739-bdd3-b8ea1cd01c40 Nov 02 15:45:14 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:14 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bdaba118-e18c-4739-bdd3-b8ea1cd01c40" returned: 0 in 0.305s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:14 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:45:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:45:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.861s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:45:14 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:45:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-167397546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e63e4e1-42bd-4b64-abef-433246519654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb35bc5633a49429449f9e5d49153a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:45:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:45:13Z,use_quota=True,user_id='3038e840f81441ef8df251df5b843daf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:45:14 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] Creating volume 4e63e4e1-42bd-4b64-abef-433246519654 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:45:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:45:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:45:14 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:45:14 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:45:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:45:14 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:45:14 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:45:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e63e4e1-42bd-4b64-abef-433246519654 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:14 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e63e4e1-42bd-4b64-abef-433246519654 1073741824 Nov 02 15:45:14 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:14 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a1b0e1e-3ae0-4d36-b811-e63cdf88203f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdaba118-e18c-4739-bdd3-b8ea1cd01c40', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:14 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd0f6067-e7c7-4845-bffd-7906ab86c443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:14 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] Volume volume-bdaba118-e18c-4739-bdd3-b8ea1cd01c40 (bdaba118-e18c-4739-bdd3-b8ea1cd01c40): created successfully Nov 02 15:45:14 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd0f6067-e7c7-4845-bffd-7906ab86c443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:14 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] Flow 'volume_create_manager' (5ab984b9-a0ce-4d27-a8be-3f08296272dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:45:14 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-eec011ff-2f67-4bc6-a596-83c188760f2c tempest-CreateVolumesFromImageTest-911315106 None] Created volume successfully. Nov 02 15:45:15 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e63e4e1-42bd-4b64-abef-433246519654 1073741824" returned: 0 in 0.572s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e63e4e1-42bd-4b64-abef-433246519654 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:15 devstack sudo[104149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e63e4e1-42bd-4b64-abef-433246519654 Nov 02 15:45:15 devstack sudo[104149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:15 devstack sudo[104149]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e63e4e1-42bd-4b64-abef-433246519654" returned: 0 in 0.250s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:15 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:45:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:45:15 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5300494-d6d3-4366-821e-bbf34428fc21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e63e4e1-42bd-4b64-abef-433246519654', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:15 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b943385-7d10-4606-ab49-0ff6d9e98e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:15 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] Volume volume-4e63e4e1-42bd-4b64-abef-433246519654 (4e63e4e1-42bd-4b64-abef-433246519654): created successfully Nov 02 15:45:15 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b943385-7d10-4606-ab49-0ff6d9e98e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:15 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] Flow 'volume_create_manager' (6421c5e5-cb48-47b9-8920-8f50573545b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:45:15 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-65bd7bae-962e-4aa5-bb0e-0e0c6a81b1dd tempest-CreateVolumesFromImageTest-911315106 None] Created volume successfully. Nov 02 15:45:16 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a6d0b2c3-88ff-40b2-b72e-575f3775df37 tempest-CreateVolumesFromImageTest-911315106 None] Acquiring lock "cinder-4e63e4e1-42bd-4b64-abef-433246519654-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:45:16 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a6d0b2c3-88ff-40b2-b72e-575f3775df37 tempest-CreateVolumesFromImageTest-911315106 None] Lock "cinder-4e63e4e1-42bd-4b64-abef-433246519654-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:45:16 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a6d0b2c3-88ff-40b2-b72e-575f3775df37 tempest-CreateVolumesFromImageTest-911315106 None] Acquiring lock "cinder-quobyte-4e63e4e1-42bd-4b64-abef-433246519654" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:45:16 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a6d0b2c3-88ff-40b2-b72e-575f3775df37 tempest-CreateVolumesFromImageTest-911315106 None] Lock "cinder-quobyte-4e63e4e1-42bd-4b64-abef-433246519654" acquired by "delete_volume" :: waited 0.015s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:45:16 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec682e6d-5bb1-46f9-8410-b3197eabad45]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:45:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a6d0b2c3-88ff-40b2-b72e-575f3775df37 tempest-CreateVolumesFromImageTest-911315106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e63e4e1-42bd-4b64-abef-433246519654 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:16 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e63e4e1-42bd-4b64-abef-433246519654 Nov 02 15:45:16 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:16 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a6d0b2c3-88ff-40b2-b72e-575f3775df37 tempest-CreateVolumesFromImageTest-911315106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e63e4e1-42bd-4b64-abef-433246519654" returned: 0 in 0.373s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a6d0b2c3-88ff-40b2-b72e-575f3775df37 tempest-CreateVolumesFromImageTest-911315106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e63e4e1-42bd-4b64-abef-433246519654 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:16 devstack sudo[104159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e63e4e1-42bd-4b64-abef-433246519654 Nov 02 15:45:16 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:16 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a6d0b2c3-88ff-40b2-b72e-575f3775df37 tempest-CreateVolumesFromImageTest-911315106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e63e4e1-42bd-4b64-abef-433246519654" returned: 0 in 0.247s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:16 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a6d0b2c3-88ff-40b2-b72e-575f3775df37 tempest-CreateVolumesFromImageTest-911315106 None] Lock "cinder-quobyte-4e63e4e1-42bd-4b64-abef-433246519654" released by "delete_volume" :: held 0.666s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:45:16 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-a6d0b2c3-88ff-40b2-b72e-575f3775df37 tempest-CreateVolumesFromImageTest-911315106 None] Created reservations ['296c6f85-a135-47f1-b7e7-11cb6332197b', '7cd6e05e-3bb6-4a37-ba62-2c4ebdc208cb', 'b76fcd9e-7e35-4edc-a75d-d3f123ce2ea4', '50030dfb-dac5-45ff-806a-88470f44129b'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:45:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a6d0b2c3-88ff-40b2-b72e-575f3775df37 tempest-CreateVolumesFromImageTest-911315106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:45:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a6d0b2c3-88ff-40b2-b72e-575f3775df37 tempest-CreateVolumesFromImageTest-911315106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:45:17 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-a6d0b2c3-88ff-40b2-b72e-575f3775df37 tempest-CreateVolumesFromImageTest-911315106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:45:17 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-a6d0b2c3-88ff-40b2-b72e-575f3775df37 tempest-CreateVolumesFromImageTest-911315106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:45:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a6d0b2c3-88ff-40b2-b72e-575f3775df37 tempest-CreateVolumesFromImageTest-911315106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:45:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a6d0b2c3-88ff-40b2-b72e-575f3775df37 tempest-CreateVolumesFromImageTest-911315106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:17 devstack sudo[104162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:45:17 devstack sudo[104162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:17 devstack sudo[104162]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a6d0b2c3-88ff-40b2-b72e-575f3775df37 tempest-CreateVolumesFromImageTest-911315106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.245s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:17 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-a6d0b2c3-88ff-40b2-b72e-575f3775df37 tempest-CreateVolumesFromImageTest-911315106 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:45:17 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-a6d0b2c3-88ff-40b2-b72e-575f3775df37 tempest-CreateVolumesFromImageTest-911315106 None] Deleted volume successfully. Nov 02 15:45:17 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a6d0b2c3-88ff-40b2-b72e-575f3775df37 tempest-CreateVolumesFromImageTest-911315106 None] Lock "cinder-4e63e4e1-42bd-4b64-abef-433246519654-delete_volume" released by "delete_volume" :: held 1.123s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:45:17 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7db42f25-df55-4c1a-ba66-c00fcc62ab25 tempest-CreateVolumesFromImageTest-911315106 None] Acquiring lock "cinder-bdaba118-e18c-4739-bdd3-b8ea1cd01c40-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:45:17 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7db42f25-df55-4c1a-ba66-c00fcc62ab25 tempest-CreateVolumesFromImageTest-911315106 None] Lock "cinder-bdaba118-e18c-4739-bdd3-b8ea1cd01c40-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:45:17 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7db42f25-df55-4c1a-ba66-c00fcc62ab25 tempest-CreateVolumesFromImageTest-911315106 None] Acquiring lock "cinder-quobyte-bdaba118-e18c-4739-bdd3-b8ea1cd01c40" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:45:17 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7db42f25-df55-4c1a-ba66-c00fcc62ab25 tempest-CreateVolumesFromImageTest-911315106 None] Lock "cinder-quobyte-bdaba118-e18c-4739-bdd3-b8ea1cd01c40" acquired by "delete_volume" :: waited 0.018s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:45:17 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0bee51-9f44-4eb5-815b-8075311dba51]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:45:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7db42f25-df55-4c1a-ba66-c00fcc62ab25 tempest-CreateVolumesFromImageTest-911315106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bdaba118-e18c-4739-bdd3-b8ea1cd01c40 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:17 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bdaba118-e18c-4739-bdd3-b8ea1cd01c40 Nov 02 15:45:17 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:17 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7db42f25-df55-4c1a-ba66-c00fcc62ab25 tempest-CreateVolumesFromImageTest-911315106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bdaba118-e18c-4739-bdd3-b8ea1cd01c40" returned: 0 in 0.359s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7db42f25-df55-4c1a-ba66-c00fcc62ab25 tempest-CreateVolumesFromImageTest-911315106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bdaba118-e18c-4739-bdd3-b8ea1cd01c40 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:17 devstack sudo[104170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bdaba118-e18c-4739-bdd3-b8ea1cd01c40 Nov 02 15:45:17 devstack sudo[104170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:18 devstack sudo[104170]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7db42f25-df55-4c1a-ba66-c00fcc62ab25 tempest-CreateVolumesFromImageTest-911315106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bdaba118-e18c-4739-bdd3-b8ea1cd01c40" returned: 0 in 0.261s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7db42f25-df55-4c1a-ba66-c00fcc62ab25 tempest-CreateVolumesFromImageTest-911315106 None] Lock "cinder-quobyte-bdaba118-e18c-4739-bdd3-b8ea1cd01c40" released by "delete_volume" :: held 0.673s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-7db42f25-df55-4c1a-ba66-c00fcc62ab25 tempest-CreateVolumesFromImageTest-911315106 None] Created reservations ['cf4b9528-e0f4-4247-8a27-d2c5289b81db', '0288a652-4f8c-4f5e-9194-f4e932223f04', 'e3d5af30-be87-414f-ba99-6a32e56eae09', 'cb61f3c9-f1fe-4e88-9cc2-c83993357f59'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7db42f25-df55-4c1a-ba66-c00fcc62ab25 tempest-CreateVolumesFromImageTest-911315106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7db42f25-df55-4c1a-ba66-c00fcc62ab25 tempest-CreateVolumesFromImageTest-911315106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7db42f25-df55-4c1a-ba66-c00fcc62ab25 tempest-CreateVolumesFromImageTest-911315106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7db42f25-df55-4c1a-ba66-c00fcc62ab25 tempest-CreateVolumesFromImageTest-911315106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7db42f25-df55-4c1a-ba66-c00fcc62ab25 tempest-CreateVolumesFromImageTest-911315106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7db42f25-df55-4c1a-ba66-c00fcc62ab25 tempest-CreateVolumesFromImageTest-911315106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:18 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:45:18 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:18 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7db42f25-df55-4c1a-ba66-c00fcc62ab25 tempest-CreateVolumesFromImageTest-911315106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.239s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-7db42f25-df55-4c1a-ba66-c00fcc62ab25 tempest-CreateVolumesFromImageTest-911315106 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:45:18 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-7db42f25-df55-4c1a-ba66-c00fcc62ab25 tempest-CreateVolumesFromImageTest-911315106 None] Deleted volume successfully. Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7db42f25-df55-4c1a-ba66-c00fcc62ab25 tempest-CreateVolumesFromImageTest-911315106 None] Lock "cinder-bdaba118-e18c-4739-bdd3-b8ea1cd01c40-delete_volume" released by "delete_volume" :: held 1.130s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4dfa1a44-9e7e-4a83-b474-712256e08f07 tempest-CreateVolumesFromImageTest-911315106 None] Acquiring lock "cinder-ce147816-04d0-4a8e-93bd-7c3d97911416-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4dfa1a44-9e7e-4a83-b474-712256e08f07 tempest-CreateVolumesFromImageTest-911315106 None] Lock "cinder-ce147816-04d0-4a8e-93bd-7c3d97911416-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4dfa1a44-9e7e-4a83-b474-712256e08f07 tempest-CreateVolumesFromImageTest-911315106 None] Acquiring lock "cinder-quobyte-ce147816-04d0-4a8e-93bd-7c3d97911416" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4dfa1a44-9e7e-4a83-b474-712256e08f07 tempest-CreateVolumesFromImageTest-911315106 None] Lock "cinder-quobyte-ce147816-04d0-4a8e-93bd-7c3d97911416" acquired by "delete_volume" :: waited 0.022s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[769e6cad-2fee-4033-984d-ecd4cc7229f9]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4dfa1a44-9e7e-4a83-b474-712256e08f07 tempest-CreateVolumesFromImageTest-911315106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ce147816-04d0-4a8e-93bd-7c3d97911416 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:18 devstack sudo[104176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ce147816-04d0-4a8e-93bd-7c3d97911416 Nov 02 15:45:18 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] Flow 'volume_create_manager' (09d2e104-7145-46a5-9c0c-0cfa0a13925b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a399e02-3bac-44af-9281-4a65696c3b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a399e02-3bac-44af-9281-4a65696c3b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1130320185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57faf504-2a96-4a40-9a05-8dc7f1f622de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d70d94738cb7416f90cb9f52f3bf3e69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:45:19Z,use_quota=True,user_id='0a6db3586b964acfa635fde0f8f424cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eae1d0c-311b-46f1-bbb1-c4dbdd7e44b0),volume_type_id=5eae1d0c-311b-46f1-bbb1-c4dbdd7e44b0)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b321bce5-88e7-44d8-b528-152fe78099c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b321bce5-88e7-44d8-b528-152fe78099c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a04959-7eb8-459e-bc84-54c31d4fa073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a04959-7eb8-459e-bc84-54c31d4fa073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57faf504-2a96-4a40-9a05-8dc7f1f622de', 'volume_name': 'volume-57faf504-2a96-4a40-9a05-8dc7f1f622de', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af8e0960-1bb3-45ad-86a3-f00ddf19eb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af8e0960-1bb3-45ad-86a3-f00ddf19eb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc1474c-64f8-4241-935d-6acf95894da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:18 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] Volume 57faf504-2a96-4a40-9a05-8dc7f1f622de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57faf504-2a96-4a40-9a05-8dc7f1f622de', 'volume_size': 1} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1130320185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57faf504-2a96-4a40-9a05-8dc7f1f622de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d70d94738cb7416f90cb9f52f3bf3e69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:45:19Z,use_quota=True,user_id='0a6db3586b964acfa635fde0f8f424cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eae1d0c-311b-46f1-bbb1-c4dbdd7e44b0),volume_type_id=5eae1d0c-311b-46f1-bbb1-c4dbdd7e44b0)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] Creating volume 57faf504-2a96-4a40-9a05-8dc7f1f622de {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:45:18 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:45:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-57faf504-2a96-4a40-9a05-8dc7f1f622de 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:18 devstack sudo[104178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-57faf504-2a96-4a40-9a05-8dc7f1f622de 1073741824 Nov 02 15:45:18 devstack sudo[104178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:19 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4dfa1a44-9e7e-4a83-b474-712256e08f07 tempest-CreateVolumesFromImageTest-911315106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ce147816-04d0-4a8e-93bd-7c3d97911416" returned: 0 in 0.399s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4dfa1a44-9e7e-4a83-b474-712256e08f07 tempest-CreateVolumesFromImageTest-911315106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ce147816-04d0-4a8e-93bd-7c3d97911416 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:19 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ce147816-04d0-4a8e-93bd-7c3d97911416 Nov 02 15:45:19 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:19 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4dfa1a44-9e7e-4a83-b474-712256e08f07 tempest-CreateVolumesFromImageTest-911315106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ce147816-04d0-4a8e-93bd-7c3d97911416" returned: 0 in 0.303s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4dfa1a44-9e7e-4a83-b474-712256e08f07 tempest-CreateVolumesFromImageTest-911315106 None] Lock "cinder-quobyte-ce147816-04d0-4a8e-93bd-7c3d97911416" released by "delete_volume" :: held 0.760s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:45:19 devstack sudo[104178]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-57faf504-2a96-4a40-9a05-8dc7f1f622de 1073741824" returned: 0 in 0.539s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-4dfa1a44-9e7e-4a83-b474-712256e08f07 tempest-CreateVolumesFromImageTest-911315106 None] Created reservations ['4a0fdde7-3cc4-4cb5-9350-20a05c981be9', '7bc93a37-2b3c-47a7-a367-7ad01e3a3d29', '87a66982-1bc5-447e-b475-fcbd2aa2998c', '88110d39-1aef-42fc-ba55-4d37d93e0367'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] Flow 'volume_create_manager' (af95493c-0ecc-4d7b-9856-9d207a71e811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cd27ea1-71a7-4028-94fc-33bf1441a221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cd27ea1-71a7-4028-94fc-33bf1441a221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-756832256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5724655a-9d85-4546-bb18-9cff9a5efe7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d70d94738cb7416f90cb9f52f3bf3e69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:45:19Z,use_quota=True,user_id='0a6db3586b964acfa635fde0f8f424cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d6259a3-831d-4f23-86f0-d39fa81d98fb),volume_type_id=9d6259a3-831d-4f23-86f0-d39fa81d98fb)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d85fa5f-0454-4096-a358-58d46c3c0fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d85fa5f-0454-4096-a358-58d46c3c0fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b73a8e9-e47c-4a8f-bad8-64c416b0e0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b73a8e9-e47c-4a8f-bad8-64c416b0e0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5724655a-9d85-4546-bb18-9cff9a5efe7b', 'volume_name': 'volume-5724655a-9d85-4546-bb18-9cff9a5efe7b', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff2d0e8-51ca-45a5-bf29-40605c677aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff2d0e8-51ca-45a5-bf29-40605c677aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (484a2d4f-94fb-41d3-b488-9b113db19f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:19 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] Volume 5724655a-9d85-4546-bb18-9cff9a5efe7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5724655a-9d85-4546-bb18-9cff9a5efe7b', 'volume_size': 1} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-57faf504-2a96-4a40-9a05-8dc7f1f622de {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:19 devstack sudo[104190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-57faf504-2a96-4a40-9a05-8dc7f1f622de Nov 02 15:45:19 devstack sudo[104190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4dfa1a44-9e7e-4a83-b474-712256e08f07 tempest-CreateVolumesFromImageTest-911315106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4dfa1a44-9e7e-4a83-b474-712256e08f07 tempest-CreateVolumesFromImageTest-911315106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4dfa1a44-9e7e-4a83-b474-712256e08f07 tempest-CreateVolumesFromImageTest-911315106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4dfa1a44-9e7e-4a83-b474-712256e08f07 tempest-CreateVolumesFromImageTest-911315106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4dfa1a44-9e7e-4a83-b474-712256e08f07 tempest-CreateVolumesFromImageTest-911315106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4dfa1a44-9e7e-4a83-b474-712256e08f07 tempest-CreateVolumesFromImageTest-911315106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:19 devstack sudo[104192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:45:19 devstack sudo[104192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-350b9064-c49a-49ea-9b2a-c6890ef9b4cf tempest-CreateVolumesFromImageTest-911315106 None] Acquiring lock "cinder-36d91c1c-d835-48be-8930-66f169e76fba-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-350b9064-c49a-49ea-9b2a-c6890ef9b4cf tempest-CreateVolumesFromImageTest-911315106 None] Lock "cinder-36d91c1c-d835-48be-8930-66f169e76fba-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-350b9064-c49a-49ea-9b2a-c6890ef9b4cf tempest-CreateVolumesFromImageTest-911315106 None] Acquiring lock "cinder-quobyte-36d91c1c-d835-48be-8930-66f169e76fba" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-350b9064-c49a-49ea-9b2a-c6890ef9b4cf tempest-CreateVolumesFromImageTest-911315106 None] Lock "cinder-quobyte-36d91c1c-d835-48be-8930-66f169e76fba" acquired by "delete_volume" :: waited 0.038s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[53828954-eec4-4ddf-af43-d3b2534f39c5]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-350b9064-c49a-49ea-9b2a-c6890ef9b4cf tempest-CreateVolumesFromImageTest-911315106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-36d91c1c-d835-48be-8930-66f169e76fba {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:19 devstack sudo[104190]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-57faf504-2a96-4a40-9a05-8dc7f1f622de" returned: 0 in 0.351s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.377s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-756832256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5724655a-9d85-4546-bb18-9cff9a5efe7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d70d94738cb7416f90cb9f52f3bf3e69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:45:19Z,use_quota=True,user_id='0a6db3586b964acfa635fde0f8f424cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d6259a3-831d-4f23-86f0-d39fa81d98fb),volume_type_id=9d6259a3-831d-4f23-86f0-d39fa81d98fb)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] Creating volume 5724655a-9d85-4546-bb18-9cff9a5efe7b {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:45:19 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5724655a-9d85-4546-bb18-9cff9a5efe7b 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dc1474c-64f8-4241-935d-6acf95894da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57faf504-2a96-4a40-9a05-8dc7f1f622de', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:19 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df2b228f-38c5-40dc-95f9-d7f769f2690e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:20 devstack sudo[104192]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:20 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5724655a-9d85-4546-bb18-9cff9a5efe7b 1073741824 Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4dfa1a44-9e7e-4a83-b474-712256e08f07 tempest-CreateVolumesFromImageTest-911315106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.357s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-4dfa1a44-9e7e-4a83-b474-712256e08f07 tempest-CreateVolumesFromImageTest-911315106 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:45:20 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:20 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-4dfa1a44-9e7e-4a83-b474-712256e08f07 tempest-CreateVolumesFromImageTest-911315106 None] Deleted volume successfully. Nov 02 15:45:20 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] Volume volume-57faf504-2a96-4a40-9a05-8dc7f1f622de (57faf504-2a96-4a40-9a05-8dc7f1f622de): created successfully Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df2b228f-38c5-40dc-95f9-d7f769f2690e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] Flow 'volume_create_manager' (09d2e104-7145-46a5-9c0c-0cfa0a13925b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:45:20 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-35883b6e-523d-4be0-b653-2a8d8b14a79c tempest-TestInstancesWithCinderVolumes-97825541 None] Created volume successfully. Nov 02 15:45:20 devstack sudo[104195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-36d91c1c-d835-48be-8930-66f169e76fba Nov 02 15:45:20 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4dfa1a44-9e7e-4a83-b474-712256e08f07 tempest-CreateVolumesFromImageTest-911315106 None] Lock "cinder-ce147816-04d0-4a8e-93bd-7c3d97911416-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Flow 'volume_create_manager' (b0464861-343a-4b4e-b458-2b224749c842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286b6504-db1b-4838-ab4f-bc650db6fe3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286b6504-db1b-4838-ab4f-bc650db6fe3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-832646538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d70d94738cb7416f90cb9f52f3bf3e69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:45:20Z,use_quota=True,user_id='0a6db3586b964acfa635fde0f8f424cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103e5df8-7dfd-4c17-81aa-152979a61761),volume_type_id=103e5df8-7dfd-4c17-81aa-152979a61761)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79732469-8566-4e20-9674-7be2483e9957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79732469-8566-4e20-9674-7be2483e9957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1ce529b-f736-4e5c-94e9-aaa821a429f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:20 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG cinder.image.glance [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Creating Keystone auth plugin from conf {{(pid=86703) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-350b9064-c49a-49ea-9b2a-c6890ef9b4cf tempest-CreateVolumesFromImageTest-911315106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-36d91c1c-d835-48be-8930-66f169e76fba" returned: 0 in 0.489s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-350b9064-c49a-49ea-9b2a-c6890ef9b4cf tempest-CreateVolumesFromImageTest-911315106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-36d91c1c-d835-48be-8930-66f169e76fba {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:20 devstack sudo[104206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-36d91c1c-d835-48be-8930-66f169e76fba Nov 02 15:45:20 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:20 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5724655a-9d85-4546-bb18-9cff9a5efe7b 1073741824" returned: 0 in 0.577s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5724655a-9d85-4546-bb18-9cff9a5efe7b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:20 devstack sudo[104209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5724655a-9d85-4546-bb18-9cff9a5efe7b Nov 02 15:45:20 devstack sudo[104209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:20 devstack sudo[104212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:45:20 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:20 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-350b9064-c49a-49ea-9b2a-c6890ef9b4cf tempest-CreateVolumesFromImageTest-911315106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-36d91c1c-d835-48be-8930-66f169e76fba" returned: 0 in 0.287s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-350b9064-c49a-49ea-9b2a-c6890ef9b4cf tempest-CreateVolumesFromImageTest-911315106 None] Lock "cinder-quobyte-36d91c1c-d835-48be-8930-66f169e76fba" released by "delete_volume" :: held 0.838s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1ce529b-f736-4e5c-94e9-aaa821a429f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3', 'volume_name': 'volume-f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3', 'volume_size': 1, 'image_id': '472b2922-b84d-49ac-b8e6-1d0531c4643f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/472b2922-b84d-49ac-b8e6-1d0531c4643f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1263915430', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd70d94738cb7416f90cb9f52f3bf3e69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '472b2922-b84d-49ac-b8e6-1d0531c4643f', 'created_at': datetime.datetime(2026, 11, 2, 14, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 14, 45, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/472b2922-b84d-49ac-b8e6-1d0531c4643f/file', 'properties': {}}, 'image_service': }' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (603dae7f-3b62-4c89-8238-19f21b5930c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (603dae7f-3b62-4c89-8238-19f21b5930c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1faac6a7-b6b7-454c-bb94-be72bb4f509e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:20 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Volume f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3', 'volume_size': 1, 'image_id': '472b2922-b84d-49ac-b8e6-1d0531c4643f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/472b2922-b84d-49ac-b8e6-1d0531c4643f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1263915430', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd70d94738cb7416f90cb9f52f3bf3e69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '472b2922-b84d-49ac-b8e6-1d0531c4643f', 'created_at': datetime.datetime(2026, 11, 2, 14, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 14, 45, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/472b2922-b84d-49ac-b8e6-1d0531c4643f/file', 'properties': {}}, 'image_service': } Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Trying to clone f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3 from image 472b2922-b84d-49ac-b8e6-1d0531c4643f at location (None, [{'url': 'file:///opt/stack/data/glance/images/472b2922-b84d-49ac-b8e6-1d0531c4643f', 'metadata': {}}]). {{(pid=86703) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-350b9064-c49a-49ea-9b2a-c6890ef9b4cf tempest-CreateVolumesFromImageTest-911315106 None] Created reservations ['b1858faf-4868-4d09-bc94-13050e98d47a', '768a79f6-6564-40f1-8045-973d572d5249', 'f6a1027a-bad7-4566-888e-34b68c9e053d', '547dd7fa-4cfa-46c9-800b-3755d0822cfe'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:45:20 devstack sudo[104209]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5724655a-9d85-4546-bb18-9cff9a5efe7b" returned: 0 in 0.277s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (484a2d4f-94fb-41d3-b488-9b113db19f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5724655a-9d85-4546-bb18-9cff9a5efe7b', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b202b10c-b584-4f05-9f26-a243b3a76392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:20 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] Volume volume-5724655a-9d85-4546-bb18-9cff9a5efe7b (5724655a-9d85-4546-bb18-9cff9a5efe7b): created successfully Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b202b10c-b584-4f05-9f26-a243b3a76392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] Flow 'volume_create_manager' (af95493c-0ecc-4d7b-9856-9d207a71e811) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-350b9064-c49a-49ea-9b2a-c6890ef9b4cf tempest-CreateVolumesFromImageTest-911315106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-350b9064-c49a-49ea-9b2a-c6890ef9b4cf tempest-CreateVolumesFromImageTest-911315106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-350b9064-c49a-49ea-9b2a-c6890ef9b4cf tempest-CreateVolumesFromImageTest-911315106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-350b9064-c49a-49ea-9b2a-c6890ef9b4cf tempest-CreateVolumesFromImageTest-911315106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-350b9064-c49a-49ea-9b2a-c6890ef9b4cf tempest-CreateVolumesFromImageTest-911315106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-350b9064-c49a-49ea-9b2a-c6890ef9b4cf tempest-CreateVolumesFromImageTest-911315106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:20 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:20 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-ac654ca2-8b36-47bc-a009-aeb42b42ecf6 tempest-TestInstancesWithCinderVolumes-97825541 None] Created volume successfully. Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.337s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager._thread_info {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:45:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread count: 29 {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 15:45:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread info: [<_MainThread(MainThread, started 125876361756800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 15:45:21 devstack sudo[104216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:45:21 devstack sudo[104216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:21 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-70cbb4ed-9653-4cea-bb14-19e9ae9207a7 tempest-CreateVolumesFromImageTest-911315106 None] Acquiring lock "cinder-717d5d0d-f611-42e7-b239-9209cf6070c1-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:45:21 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-70cbb4ed-9653-4cea-bb14-19e9ae9207a7 tempest-CreateVolumesFromImageTest-911315106 None] Lock "cinder-717d5d0d-f611-42e7-b239-9209cf6070c1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:45:21 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-70cbb4ed-9653-4cea-bb14-19e9ae9207a7 tempest-CreateVolumesFromImageTest-911315106 None] Acquiring lock "cinder-quobyte-717d5d0d-f611-42e7-b239-9209cf6070c1" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:45:21 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-70cbb4ed-9653-4cea-bb14-19e9ae9207a7 tempest-CreateVolumesFromImageTest-911315106 None] Lock "cinder-quobyte-717d5d0d-f611-42e7-b239-9209cf6070c1" acquired by "delete_volume" :: waited 0.017s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:45:21 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d358406-5ff1-4a54-8ce1-0bea6126419d]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:45:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-70cbb4ed-9653-4cea-bb14-19e9ae9207a7 tempest-CreateVolumesFromImageTest-911315106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-717d5d0d-f611-42e7-b239-9209cf6070c1 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:21 devstack sudo[104216]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-350b9064-c49a-49ea-9b2a-c6890ef9b4cf tempest-CreateVolumesFromImageTest-911315106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.283s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:21 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-350b9064-c49a-49ea-9b2a-c6890ef9b4cf tempest-CreateVolumesFromImageTest-911315106 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:45:21 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-350b9064-c49a-49ea-9b2a-c6890ef9b4cf tempest-CreateVolumesFromImageTest-911315106 None] Deleted volume successfully. Nov 02 15:45:21 devstack sudo[104218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-717d5d0d-f611-42e7-b239-9209cf6070c1 Nov 02 15:45:21 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:21 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-350b9064-c49a-49ea-9b2a-c6890ef9b4cf tempest-CreateVolumesFromImageTest-911315106 None] Lock "cinder-36d91c1c-d835-48be-8930-66f169e76fba-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:45:21 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-70cbb4ed-9653-4cea-bb14-19e9ae9207a7 tempest-CreateVolumesFromImageTest-911315106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-717d5d0d-f611-42e7-b239-9209cf6070c1" returned: 0 in 0.388s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-70cbb4ed-9653-4cea-bb14-19e9ae9207a7 tempest-CreateVolumesFromImageTest-911315106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-717d5d0d-f611-42e7-b239-9209cf6070c1 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:21 devstack sudo[104224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-717d5d0d-f611-42e7-b239-9209cf6070c1 Nov 02 15:45:21 devstack sudo[104224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:21 devstack sudo[104224]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-70cbb4ed-9653-4cea-bb14-19e9ae9207a7 tempest-CreateVolumesFromImageTest-911315106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-717d5d0d-f611-42e7-b239-9209cf6070c1" returned: 0 in 0.247s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:21 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-70cbb4ed-9653-4cea-bb14-19e9ae9207a7 tempest-CreateVolumesFromImageTest-911315106 None] Lock "cinder-quobyte-717d5d0d-f611-42e7-b239-9209cf6070c1" released by "delete_volume" :: held 0.683s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:45:21 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-70cbb4ed-9653-4cea-bb14-19e9ae9207a7 tempest-CreateVolumesFromImageTest-911315106 None] Created reservations ['d8dfd9fe-e80d-474b-a64d-8306d69dd5ac', '39fe9be4-4a14-437b-b470-05cbdc50c7c9', '0ac9183c-0cf9-46a6-b7cc-63ae58b96dff', '4289b730-0275-43fd-9adf-673799497bdf'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:45:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-70cbb4ed-9653-4cea-bb14-19e9ae9207a7 tempest-CreateVolumesFromImageTest-911315106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:45:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-70cbb4ed-9653-4cea-bb14-19e9ae9207a7 tempest-CreateVolumesFromImageTest-911315106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:45:21 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-70cbb4ed-9653-4cea-bb14-19e9ae9207a7 tempest-CreateVolumesFromImageTest-911315106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:45:21 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-70cbb4ed-9653-4cea-bb14-19e9ae9207a7 tempest-CreateVolumesFromImageTest-911315106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:45:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-70cbb4ed-9653-4cea-bb14-19e9ae9207a7 tempest-CreateVolumesFromImageTest-911315106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:45:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-70cbb4ed-9653-4cea-bb14-19e9ae9207a7 tempest-CreateVolumesFromImageTest-911315106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:21 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:45:21 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:22 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-70cbb4ed-9653-4cea-bb14-19e9ae9207a7 tempest-CreateVolumesFromImageTest-911315106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.254s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:22 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-70cbb4ed-9653-4cea-bb14-19e9ae9207a7 tempest-CreateVolumesFromImageTest-911315106 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:45:22 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-70cbb4ed-9653-4cea-bb14-19e9ae9207a7 tempest-CreateVolumesFromImageTest-911315106 None] Deleted volume successfully. Nov 02 15:45:22 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-70cbb4ed-9653-4cea-bb14-19e9ae9207a7 tempest-CreateVolumesFromImageTest-911315106 None] Lock "cinder-717d5d0d-f611-42e7-b239-9209cf6070c1-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:45:24 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_472b2922-b84d-49ac-b8e6-1d0531c4643f_xu9te2ocdevstack@QuobyteHD, size 20.69 MB, duration 3.46 sec {{(pid=86703) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 15:45:24 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Image download 20.69 MB at 5.99 MB/s Nov 02 15:45:24 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b03d862-69e0-467c-beba-c8bde312f67d]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:45:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_472b2922-b84d-49ac-b8e6-1d0531c4643f_xu9te2ocdevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:24 devstack sudo[104231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_472b2922-b84d-49ac-b8e6-1d0531c4643f_xu9te2ocdevstack@QuobyteHD Nov 02 15:45:24 devstack sudo[104231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:24 devstack sudo[104231]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_472b2922-b84d-49ac-b8e6-1d0531c4643f_xu9te2ocdevstack@QuobyteHD" returned: 0 in 0.328s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:24 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Temporary image 472b2922-b84d-49ac-b8e6-1d0531c4643f is fetched for user 0a6db3586b964acfa635fde0f8f424cd. {{(pid=86703) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 15:45:24 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8099c42e-2e66-494e-90d2-6e53cdf94609]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:45:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_472b2922-b84d-49ac-b8e6-1d0531c4643f_xu9te2ocdevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:24 devstack sudo[104236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_472b2922-b84d-49ac-b8e6-1d0531c4643f_xu9te2ocdevstack@QuobyteHD Nov 02 15:45:24 devstack sudo[104236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:24 devstack sudo[104236]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_472b2922-b84d-49ac-b8e6-1d0531c4643f_xu9te2ocdevstack@QuobyteHD" returned: 0 in 0.332s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:45:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:45:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:45:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-832646538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d70d94738cb7416f90cb9f52f3bf3e69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:45:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:45:20Z,use_quota=True,user_id='0a6db3586b964acfa635fde0f8f424cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(103e5df8-7dfd-4c17-81aa-152979a61761),volume_type_id=103e5df8-7dfd-4c17-81aa-152979a61761)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:45:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Creating volume f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:45:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:45:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:45:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:45:25 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:25 devstack sudo[104241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3 1073741824 Nov 02 15:45:25 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] Flow 'volume_create_manager' (ae175c21-9533-4773-b5d5-7fdf50d28870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b08740-48ff-4e06-a8ac-3a11d631692e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b08740-48ff-4e06-a8ac-3a11d631692e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea50e6b9-3c8e-4855-99ce-51c761cb5f02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4f440a79664253bf4dec7b9b3acfa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:45:25Z,use_quota=True,user_id='2e1f326278e942d381a217c838953a3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a7e552f-3ac5-45a1-a963-a78b41e50b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a7e552f-3ac5-45a1-a963-a78b41e50b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0efef80-de02-40ca-b18f-5df9cdd50b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0efef80-de02-40ca-b18f-5df9cdd50b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea50e6b9-3c8e-4855-99ce-51c761cb5f02', 'volume_name': 'volume-ea50e6b9-3c8e-4855-99ce-51c761cb5f02', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a7fbad-14df-415f-ac1f-4e69cb4126cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a7fbad-14df-415f-ac1f-4e69cb4126cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dcd3a44-3648-4bf1-9f3a-059f04a08983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:25 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] Volume ea50e6b9-3c8e-4855-99ce-51c761cb5f02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea50e6b9-3c8e-4855-99ce-51c761cb5f02', 'volume_size': 1} Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:45:25 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3 1073741824" returned: 0 in 0.523s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:25 devstack sudo[104247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3 Nov 02 15:45:25 devstack sudo[104247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:25 devstack sudo[104247]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3" returned: 0 in 0.244s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.328s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:45:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea50e6b9-3c8e-4855-99ce-51c761cb5f02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4f440a79664253bf4dec7b9b3acfa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:45:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:45:25Z,use_quota=True,user_id='2e1f326278e942d381a217c838953a3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] Creating volume ea50e6b9-3c8e-4855-99ce-51c761cb5f02 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:45:25 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ea50e6b9-3c8e-4855-99ce-51c761cb5f02 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:25 devstack sudo[104251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ea50e6b9-3c8e-4855-99ce-51c761cb5f02 1073741824 Nov 02 15:45:25 devstack sudo[104251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG cinder.volume.volume_utils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Attempting download of 472b2922-b84d-49ac-b8e6-1d0531c4643f ((None, [{'url': 'file:///opt/stack/data/glance/images/472b2922-b84d-49ac-b8e6-1d0531c4643f', 'metadata': {}}])) to volume f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3. {{(pid=86703) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[932366b3-d267-422e-835c-b372e04a0347]: (4, 'raw') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:45:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_472b2922-b84d-49ac-b8e6-1d0531c4643f_ihnp3shk {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:26 devstack sudo[104253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_472b2922-b84d-49ac-b8e6-1d0531c4643f_ihnp3shk Nov 02 15:45:26 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:26 devstack sudo[104251]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ea50e6b9-3c8e-4855-99ce-51c761cb5f02 1073741824" returned: 0 in 0.473s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:26 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_472b2922-b84d-49ac-b8e6-1d0531c4643f_ihnp3shk" returned: 0 in 0.403s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_472b2922-b84d-49ac-b8e6-1d0531c4643f_ihnp3shk {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ea50e6b9-3c8e-4855-99ce-51c761cb5f02 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:26 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ea50e6b9-3c8e-4855-99ce-51c761cb5f02 Nov 02 15:45:26 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:26 devstack sudo[104261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_472b2922-b84d-49ac-b8e6-1d0531c4643f_ihnp3shk Nov 02 15:45:26 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:26 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ea50e6b9-3c8e-4855-99ce-51c761cb5f02" returned: 0 in 0.276s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:45:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:45:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dcd3a44-3648-4bf1-9f3a-059f04a08983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea50e6b9-3c8e-4855-99ce-51c761cb5f02', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66eeafc7-9372-4d26-bac7-13486472e102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:26 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_472b2922-b84d-49ac-b8e6-1d0531c4643f_ihnp3shk" returned: 1 in 0.338s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_472b2922-b84d-49ac-b8e6-1d0531c4643f_ihnp3shk' failed. Not Retrying. {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 15:45:26 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cc0524-5ce3-4a62-98b3-33fa6aad8965]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:45:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_472b2922-b84d-49ac-b8e6-1d0531c4643f_xu9te2ocdevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:26 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] Volume volume-ea50e6b9-3c8e-4855-99ce-51c761cb5f02 (ea50e6b9-3c8e-4855-99ce-51c761cb5f02): created successfully Nov 02 15:45:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66eeafc7-9372-4d26-bac7-13486472e102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] Flow 'volume_create_manager' (ae175c21-9533-4773-b5d5-7fdf50d28870) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:45:26 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-3649e666-8dae-4322-9aa5-5e818e1afd55 tempest-CinderUnicodeTest-300199184 None] Created volume successfully. Nov 02 15:45:26 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_472b2922-b84d-49ac-b8e6-1d0531c4643f_xu9te2ocdevstack@QuobyteHD Nov 02 15:45:26 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:26 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_472b2922-b84d-49ac-b8e6-1d0531c4643f_xu9te2ocdevstack@QuobyteHD" returned: 0 in 0.319s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:26 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] 472b2922-b84d-49ac-b8e6-1d0531c4643f was qcow2, converting to qcow2 {{(pid=86703) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 15:45:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_472b2922-b84d-49ac-b8e6-1d0531c4643f_xu9te2ocdevstack@QuobyteHD /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:27 devstack sudo[104273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_472b2922-b84d-49ac-b8e6-1d0531c4643f_xu9te2ocdevstack@QuobyteHD /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3 Nov 02 15:45:27 devstack sudo[104273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:27 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:45:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] Flow 'volume_create_manager' (521f8730-9671-4b61-8c84-2d393232994e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:45:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23ad6a69-c254-4ed6-bca0-90a96e6c073b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23ad6a69-c254-4ed6-bca0-90a96e6c073b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:45:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1880693481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbb0f661-6bf1-46d6-9093-dc70ddc29130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4f440a79664253bf4dec7b9b3acfa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:45:28Z,use_quota=True,user_id='2e1f326278e942d381a217c838953a3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8ee22c1-3061-4d8f-b415-9719e7e73a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8ee22c1-3061-4d8f-b415-9719e7e73a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed420cc4-72ce-4773-95f4-54c7cb0c0e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed420cc4-72ce-4773-95f4-54c7cb0c0e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbb0f661-6bf1-46d6-9093-dc70ddc29130', 'volume_name': 'volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27849819-2577-494a-9341-0957e1d7de35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27849819-2577-494a-9341-0957e1d7de35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (951a0cad-ab08-4898-acae-79c255b87c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:28 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] Volume bbb0f661-6bf1-46d6-9093-dc70ddc29130: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130', 'volume_size': 1} Nov 02 15:45:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:45:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:45:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:45:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1880693481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbb0f661-6bf1-46d6-9093-dc70ddc29130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d4f440a79664253bf4dec7b9b3acfa4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:45:28Z,use_quota=True,user_id='2e1f326278e942d381a217c838953a3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:45:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] Creating volume bbb0f661-6bf1-46d6-9093-dc70ddc29130 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:45:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:45:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:45:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:45:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:45:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:45:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:45:28 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:45:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:28 devstack sudo[104281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130 1073741824 Nov 02 15:45:28 devstack sudo[104281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:28 devstack sudo[104281]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130 1073741824" returned: 0 in 0.473s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:28 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130 Nov 02 15:45:28 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:28 devstack sudo[104273]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_472b2922-b84d-49ac-b8e6-1d0531c4643f_xu9te2ocdevstack@QuobyteHD /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3" returned: 0 in 1.817s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:28 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_472b2922-b84d-49ac-b8e6-1d0531c4643f_xu9te2ocdevstack@QuobyteHD, size 112.00 MB, duration 1.82 sec, destination /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3 {{(pid=86703) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 15:45:28 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Converted 112.00 MB image at 61.58 MB/s Nov 02 15:45:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:28 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3 1G Nov 02 15:45:28 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:28 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130" returned: 0 in 0.259s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:45:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:45:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (951a0cad-ab08-4898-acae-79c255b87c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (919ed8fd-7931-40a8-b553-08f1f069bb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:28 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] Volume volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130 (bbb0f661-6bf1-46d6-9093-dc70ddc29130): created successfully Nov 02 15:45:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (919ed8fd-7931-40a8-b553-08f1f069bb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] Flow 'volume_create_manager' (521f8730-9671-4b61-8c84-2d393232994e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:45:28 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-28740846-7e9f-45f3-8048-a2fa8965332e tempest-CinderUnicodeTest-300199184 None] Created volume successfully. Nov 02 15:45:29 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3 1G" returned: 0 in 0.334s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:29 devstack cinder-volume[86703]: DEBUG cinder.volume.volume_utils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Downloaded image 472b2922-b84d-49ac-b8e6-1d0531c4643f ((None, [{'url': 'file:///opt/stack/data/glance/images/472b2922-b84d-49ac-b8e6-1d0531c4643f', 'metadata': {}}])) to volume f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3 successfully. {{(pid=86703) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 15:45:29 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Temporary image 472b2922-b84d-49ac-b8e6-1d0531c4643f for user 0a6db3586b964acfa635fde0f8f424cd is deleted. {{(pid=86703) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 15:45:29 devstack cinder-volume[86703]: DEBUG cinder.volume.volume_utils [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Marking volume f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3 as bootable. {{(pid=86703) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 15:45:29 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Copying metadata from image 472b2922-b84d-49ac-b8e6-1d0531c4643f to f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3. {{(pid=86703) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 15:45:29 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Creating volume glance metadata for volume f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3 backed by image 472b2922-b84d-49ac-b8e6-1d0531c4643f with: {'image_id': '472b2922-b84d-49ac-b8e6-1d0531c4643f', 'image_name': 'tempest-scenario-img--1263915430', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86703) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 15:45:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1faac6a7-b6b7-454c-bb94-be72bb4f509e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3', 'volume_size': 1, 'image_id': '472b2922-b84d-49ac-b8e6-1d0531c4643f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/472b2922-b84d-49ac-b8e6-1d0531c4643f', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1263915430', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd70d94738cb7416f90cb9f52f3bf3e69', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '472b2922-b84d-49ac-b8e6-1d0531c4643f', 'created_at': datetime.datetime(2026, 11, 2, 14, 45, 16, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 14, 45, 18, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/472b2922-b84d-49ac-b8e6-1d0531c4643f/file', 'properties': {}}, 'image_service': }' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a051417-1b54-4515-8482-a1a92b4c068d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:45:29 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Volume volume-f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3 (f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3): created successfully Nov 02 15:45:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a051417-1b54-4515-8482-a1a92b4c068d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:45:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Flow 'volume_create_manager' (b0464861-343a-4b4e-b458-2b224749c842) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:45:29 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-1f7575f9-c791-41e9-9420-d199333f5205 tempest-TestInstancesWithCinderVolumes-97825541 None] Created volume successfully. Nov 02 15:45:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-e72fc076-0ac7-49a7-8023-fa7810b08de1 tempest-CinderUnicodeTest-300199184 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:45:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-e72fc076-0ac7-49a7-8023-fa7810b08de1 tempest-CinderUnicodeTest-300199184 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:45:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-e72fc076-0ac7-49a7-8023-fa7810b08de1 tempest-CinderUnicodeTest-300199184 None] Creating offline snapshot 5622fe3b-7058-46cd-80c0-692935e6edf0 of volume bbb0f661-6bf1-46d6-9093-dc70ddc29130 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:45:30 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5411143-f72c-4941-a92b-5878e25af1f5]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:45:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e72fc076-0ac7-49a7-8023-fa7810b08de1 tempest-CinderUnicodeTest-300199184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:30 devstack sudo[104295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130 Nov 02 15:45:30 devstack sudo[104295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:30 devstack sudo[104295]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e72fc076-0ac7-49a7-8023-fa7810b08de1 tempest-CinderUnicodeTest-300199184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130" returned: 0 in 0.382s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e72fc076-0ac7-49a7-8023-fa7810b08de1 tempest-CinderUnicodeTest-300199184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130.5622fe3b-7058-46cd-80c0-692935e6edf0 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:30 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130.5622fe3b-7058-46cd-80c0-692935e6edf0 1G Nov 02 15:45:30 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:31 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e72fc076-0ac7-49a7-8023-fa7810b08de1 tempest-CinderUnicodeTest-300199184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130.5622fe3b-7058-46cd-80c0-692935e6edf0 1G" returned: 0 in 0.449s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e72fc076-0ac7-49a7-8023-fa7810b08de1 tempest-CinderUnicodeTest-300199184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130.5622fe3b-7058-46cd-80c0-692935e6edf0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:31 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130.5622fe3b-7058-46cd-80c0-692935e6edf0 Nov 02 15:45:31 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:31 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e72fc076-0ac7-49a7-8023-fa7810b08de1 tempest-CinderUnicodeTest-300199184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130.5622fe3b-7058-46cd-80c0-692935e6edf0" returned: 0 in 0.328s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:31 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-e72fc076-0ac7-49a7-8023-fa7810b08de1 tempest-CinderUnicodeTest-300199184 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130.5622fe3b-7058-46cd-80c0-692935e6edf0 is being set with open permissions: ugo+rw Nov 02 15:45:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e72fc076-0ac7-49a7-8023-fa7810b08de1 tempest-CinderUnicodeTest-300199184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130.5622fe3b-7058-46cd-80c0-692935e6edf0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:31 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130.5622fe3b-7058-46cd-80c0-692935e6edf0 Nov 02 15:45:31 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:31 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e72fc076-0ac7-49a7-8023-fa7810b08de1 tempest-CinderUnicodeTest-300199184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130.5622fe3b-7058-46cd-80c0-692935e6edf0" returned: 0 in 0.256s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e72fc076-0ac7-49a7-8023-fa7810b08de1 tempest-CinderUnicodeTest-300199184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:31 devstack sudo[104315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130.info Nov 02 15:45:31 devstack sudo[104315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:32 devstack sudo[104315]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e72fc076-0ac7-49a7-8023-fa7810b08de1 tempest-CinderUnicodeTest-300199184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130.info" returned: 0 in 0.275s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:32 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-e72fc076-0ac7-49a7-8023-fa7810b08de1 tempest-CinderUnicodeTest-300199184 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130.info is being set with open permissions: ugo+rw Nov 02 15:45:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e72fc076-0ac7-49a7-8023-fa7810b08de1 tempest-CinderUnicodeTest-300199184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:32 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130.info Nov 02 15:45:32 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:32 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e72fc076-0ac7-49a7-8023-fa7810b08de1 tempest-CinderUnicodeTest-300199184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130.info" returned: 0 in 0.322s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-e72fc076-0ac7-49a7-8023-fa7810b08de1 tempest-CinderUnicodeTest-300199184 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.122s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:45:32 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-e72fc076-0ac7-49a7-8023-fa7810b08de1 tempest-CinderUnicodeTest-300199184 None] Create snapshot completed successfully Nov 02 15:45:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-71650157-2f73-4485-8183-9575d887cfdb req-1777b3fa-2502-40ea-96fe-40ec5764fc76 tempest-TestInstancesWithCinderVolumes-97825541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:45:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-71650157-2f73-4485-8183-9575d887cfdb req-1777b3fa-2502-40ea-96fe-40ec5764fc76 tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:45:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-71650157-2f73-4485-8183-9575d887cfdb req-1777b3fa-2502-40ea-96fe-40ec5764fc76 tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:45:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-71650157-2f73-4485-8183-9575d887cfdb req-1777b3fa-2502-40ea-96fe-40ec5764fc76 tempest-TestInstancesWithCinderVolumes-97825541 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478', 'name': 'volume-f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4a478b56-9754-402c-b48b-7186c0ace8be', 'enforce_multipath': True} {{(pid=86703) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 15:45:32 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-71650157-2f73-4485-8183-9575d887cfdb req-1777b3fa-2502-40ea-96fe-40ec5764fc76 tempest-TestInstancesWithCinderVolumes-97825541 None] attachment_update completed successfully. Nov 02 15:45:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-1f4c1684-18c4-48de-bcb0-3ad8209dd50b tempest-CinderUnicodeTest-300199184 None] Acquiring lock "cinder-5622fe3b-7058-46cd-80c0-692935e6edf0-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:45:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-1f4c1684-18c4-48de-bcb0-3ad8209dd50b tempest-CinderUnicodeTest-300199184 None] Lock "cinder-5622fe3b-7058-46cd-80c0-692935e6edf0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:45:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-1f4c1684-18c4-48de-bcb0-3ad8209dd50b tempest-CinderUnicodeTest-300199184 None] Acquiring lock "cinder-quobyte-bbb0f661-6bf1-46d6-9093-dc70ddc29130" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:45:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-1f4c1684-18c4-48de-bcb0-3ad8209dd50b tempest-CinderUnicodeTest-300199184 None] Lock "cinder-quobyte-bbb0f661-6bf1-46d6-9093-dc70ddc29130" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:45:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-1f4c1684-18c4-48de-bcb0-3ad8209dd50b tempest-CinderUnicodeTest-300199184 None] Acquiring lock "cinder-quobyte-5622fe3b-7058-46cd-80c0-692935e6edf0" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:45:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-1f4c1684-18c4-48de-bcb0-3ad8209dd50b tempest-CinderUnicodeTest-300199184 None] Lock "cinder-quobyte-5622fe3b-7058-46cd-80c0-692935e6edf0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:45:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-1f4c1684-18c4-48de-bcb0-3ad8209dd50b tempest-CinderUnicodeTest-300199184 None] Deleting offline snapshot 5622fe3b-7058-46cd-80c0-692935e6edf0 of volume bbb0f661-6bf1-46d6-9093-dc70ddc29130 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:45:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-1f4c1684-18c4-48de-bcb0-3ad8209dd50b tempest-CinderUnicodeTest-300199184 None] snapshot_file for this snap is: volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130.5622fe3b-7058-46cd-80c0-692935e6edf0 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:45:33 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe333e62-9d3a-412c-8b97-0195b6a3b5bb]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:45:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1f4c1684-18c4-48de-bcb0-3ad8209dd50b tempest-CinderUnicodeTest-300199184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130.5622fe3b-7058-46cd-80c0-692935e6edf0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:33 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130.5622fe3b-7058-46cd-80c0-692935e6edf0 Nov 02 15:45:33 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:34 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1f4c1684-18c4-48de-bcb0-3ad8209dd50b tempest-CinderUnicodeTest-300199184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130.5622fe3b-7058-46cd-80c0-692935e6edf0" returned: 0 in 0.367s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:34 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-1f4c1684-18c4-48de-bcb0-3ad8209dd50b tempest-CinderUnicodeTest-300199184 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:45:34 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca935af-88f4-4d86-a6db-465bba583407]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:45:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1f4c1684-18c4-48de-bcb0-3ad8209dd50b tempest-CinderUnicodeTest-300199184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:34 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130 Nov 02 15:45:34 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:34 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1f4c1684-18c4-48de-bcb0-3ad8209dd50b tempest-CinderUnicodeTest-300199184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130" returned: 0 in 0.374s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1f4c1684-18c4-48de-bcb0-3ad8209dd50b tempest-CinderUnicodeTest-300199184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130.5622fe3b-7058-46cd-80c0-692935e6edf0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:34 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130.5622fe3b-7058-46cd-80c0-692935e6edf0 Nov 02 15:45:34 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:34 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1f4c1684-18c4-48de-bcb0-3ad8209dd50b tempest-CinderUnicodeTest-300199184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130.5622fe3b-7058-46cd-80c0-692935e6edf0" returned: 0 in 0.442s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1f4c1684-18c4-48de-bcb0-3ad8209dd50b tempest-CinderUnicodeTest-300199184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130.5622fe3b-7058-46cd-80c0-692935e6edf0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:34 devstack sudo[104347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130.5622fe3b-7058-46cd-80c0-692935e6edf0 Nov 02 15:45:34 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:35 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1f4c1684-18c4-48de-bcb0-3ad8209dd50b tempest-CinderUnicodeTest-300199184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130.5622fe3b-7058-46cd-80c0-692935e6edf0" returned: 0 in 0.392s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-1f4c1684-18c4-48de-bcb0-3ad8209dd50b tempest-CinderUnicodeTest-300199184 None] Lock "cinder-quobyte-5622fe3b-7058-46cd-80c0-692935e6edf0" released by "_delete_snapshot" :: held 1.760s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:45:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-1f4c1684-18c4-48de-bcb0-3ad8209dd50b tempest-CinderUnicodeTest-300199184 None] Lock "cinder-quobyte-bbb0f661-6bf1-46d6-9093-dc70ddc29130" released by "delete_snapshot" :: held 1.789s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:45:35 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-1f4c1684-18c4-48de-bcb0-3ad8209dd50b tempest-CinderUnicodeTest-300199184 None] Created reservations ['e06aae53-b32c-48c4-b358-779fa34ef528', '90c4c2a6-4b59-49fb-a4cf-4b2f10ff6abf', 'c8fa9409-2e82-460c-9874-973713a82c4a', '72271607-7c77-4e61-b642-0b27fa22c1b6'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:45:35 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-1f4c1684-18c4-48de-bcb0-3ad8209dd50b tempest-CinderUnicodeTest-300199184 None] Delete snapshot completed successfully. Nov 02 15:45:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-1f4c1684-18c4-48de-bcb0-3ad8209dd50b tempest-CinderUnicodeTest-300199184 None] Lock "cinder-5622fe3b-7058-46cd-80c0-692935e6edf0-delete_snapshot" released by "delete_snapshot" :: held 2.095s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:45:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d3b971b5-d2b8-407f-a7e2-593eeac52ca4 tempest-CinderUnicodeTest-300199184 None] Acquiring lock "cinder-bbb0f661-6bf1-46d6-9093-dc70ddc29130-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:45:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d3b971b5-d2b8-407f-a7e2-593eeac52ca4 tempest-CinderUnicodeTest-300199184 None] Lock "cinder-bbb0f661-6bf1-46d6-9093-dc70ddc29130-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:45:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d3b971b5-d2b8-407f-a7e2-593eeac52ca4 tempest-CinderUnicodeTest-300199184 None] Acquiring lock "cinder-quobyte-bbb0f661-6bf1-46d6-9093-dc70ddc29130" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:45:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d3b971b5-d2b8-407f-a7e2-593eeac52ca4 tempest-CinderUnicodeTest-300199184 None] Lock "cinder-quobyte-bbb0f661-6bf1-46d6-9093-dc70ddc29130" acquired by "delete_volume" :: waited 0.015s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:45:36 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9ad117-3d43-4942-a646-702676ea34eb]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:45:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d3b971b5-d2b8-407f-a7e2-593eeac52ca4 tempest-CinderUnicodeTest-300199184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:36 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130 Nov 02 15:45:36 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:36 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d3b971b5-d2b8-407f-a7e2-593eeac52ca4 tempest-CinderUnicodeTest-300199184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130" returned: 0 in 0.537s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d3b971b5-d2b8-407f-a7e2-593eeac52ca4 tempest-CinderUnicodeTest-300199184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:36 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130 Nov 02 15:45:36 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:36 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d3b971b5-d2b8-407f-a7e2-593eeac52ca4 tempest-CinderUnicodeTest-300199184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bbb0f661-6bf1-46d6-9093-dc70ddc29130" returned: 0 in 0.246s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d3b971b5-d2b8-407f-a7e2-593eeac52ca4 tempest-CinderUnicodeTest-300199184 None] Lock "cinder-quobyte-bbb0f661-6bf1-46d6-9093-dc70ddc29130" released by "delete_volume" :: held 0.887s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:45:36 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-d3b971b5-d2b8-407f-a7e2-593eeac52ca4 tempest-CinderUnicodeTest-300199184 None] Created reservations ['8d563d66-068d-407b-bf44-4bbd941bd86b', '1993b45a-7ed9-4817-83cd-bf30999bb0bd', '8ed649ed-b1a1-4843-ba66-30189e0ebc9e', 'b18b930f-7281-4ad5-905e-47da3c49efbe'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:45:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d3b971b5-d2b8-407f-a7e2-593eeac52ca4 tempest-CinderUnicodeTest-300199184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:45:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d3b971b5-d2b8-407f-a7e2-593eeac52ca4 tempest-CinderUnicodeTest-300199184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:45:36 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d3b971b5-d2b8-407f-a7e2-593eeac52ca4 tempest-CinderUnicodeTest-300199184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:45:36 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d3b971b5-d2b8-407f-a7e2-593eeac52ca4 tempest-CinderUnicodeTest-300199184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:45:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d3b971b5-d2b8-407f-a7e2-593eeac52ca4 tempest-CinderUnicodeTest-300199184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:45:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d3b971b5-d2b8-407f-a7e2-593eeac52ca4 tempest-CinderUnicodeTest-300199184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:37 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:45:37 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:37 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7bd3179f-3a1b-47e1-8748-10ea66b7e781 tempest-CinderUnicodeTest-300199184 None] Acquiring lock "cinder-ea50e6b9-3c8e-4855-99ce-51c761cb5f02-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:45:37 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7bd3179f-3a1b-47e1-8748-10ea66b7e781 tempest-CinderUnicodeTest-300199184 None] Lock "cinder-ea50e6b9-3c8e-4855-99ce-51c761cb5f02-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:45:37 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7bd3179f-3a1b-47e1-8748-10ea66b7e781 tempest-CinderUnicodeTest-300199184 None] Acquiring lock "cinder-quobyte-ea50e6b9-3c8e-4855-99ce-51c761cb5f02" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:45:37 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7bd3179f-3a1b-47e1-8748-10ea66b7e781 tempest-CinderUnicodeTest-300199184 None] Lock "cinder-quobyte-ea50e6b9-3c8e-4855-99ce-51c761cb5f02" acquired by "delete_volume" :: waited 0.019s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:45:37 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd054a7-fcb6-44fc-937f-3e835b93646b]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:45:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7bd3179f-3a1b-47e1-8748-10ea66b7e781 tempest-CinderUnicodeTest-300199184 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ea50e6b9-3c8e-4855-99ce-51c761cb5f02 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:37 devstack sudo[104837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ea50e6b9-3c8e-4855-99ce-51c761cb5f02 Nov 02 15:45:37 devstack sudo[104837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:37 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d3b971b5-d2b8-407f-a7e2-593eeac52ca4 tempest-CinderUnicodeTest-300199184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.427s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:37 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-d3b971b5-d2b8-407f-a7e2-593eeac52ca4 tempest-CinderUnicodeTest-300199184 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:45:37 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-d3b971b5-d2b8-407f-a7e2-593eeac52ca4 tempest-CinderUnicodeTest-300199184 None] Deleted volume successfully. Nov 02 15:45:37 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d3b971b5-d2b8-407f-a7e2-593eeac52ca4 tempest-CinderUnicodeTest-300199184 None] Lock "cinder-bbb0f661-6bf1-46d6-9093-dc70ddc29130-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:45:37 devstack sudo[104837]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7bd3179f-3a1b-47e1-8748-10ea66b7e781 tempest-CinderUnicodeTest-300199184 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ea50e6b9-3c8e-4855-99ce-51c761cb5f02" returned: 0 in 0.548s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7bd3179f-3a1b-47e1-8748-10ea66b7e781 tempest-CinderUnicodeTest-300199184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ea50e6b9-3c8e-4855-99ce-51c761cb5f02 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:37 devstack sudo[104843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ea50e6b9-3c8e-4855-99ce-51c761cb5f02 Nov 02 15:45:37 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:38 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7bd3179f-3a1b-47e1-8748-10ea66b7e781 tempest-CinderUnicodeTest-300199184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ea50e6b9-3c8e-4855-99ce-51c761cb5f02" returned: 0 in 0.294s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:38 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7bd3179f-3a1b-47e1-8748-10ea66b7e781 tempest-CinderUnicodeTest-300199184 None] Lock "cinder-quobyte-ea50e6b9-3c8e-4855-99ce-51c761cb5f02" released by "delete_volume" :: held 0.905s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:45:38 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-7bd3179f-3a1b-47e1-8748-10ea66b7e781 tempest-CinderUnicodeTest-300199184 None] Created reservations ['459ebd7a-2d3e-4723-89d1-e87c71d0614f', '34a37c60-4c5f-4aed-a504-3a2f1f071220', '6ad7bb5d-db15-4546-86ae-8e99a4352278', '0034e550-099e-4065-a6a2-22d8f075e472'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:45:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7bd3179f-3a1b-47e1-8748-10ea66b7e781 tempest-CinderUnicodeTest-300199184 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:45:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7bd3179f-3a1b-47e1-8748-10ea66b7e781 tempest-CinderUnicodeTest-300199184 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:45:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7bd3179f-3a1b-47e1-8748-10ea66b7e781 tempest-CinderUnicodeTest-300199184 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:45:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7bd3179f-3a1b-47e1-8748-10ea66b7e781 tempest-CinderUnicodeTest-300199184 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:45:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7bd3179f-3a1b-47e1-8748-10ea66b7e781 tempest-CinderUnicodeTest-300199184 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:45:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7bd3179f-3a1b-47e1-8748-10ea66b7e781 tempest-CinderUnicodeTest-300199184 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:45:38 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:45:38 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:45:38 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Nov 02 15:45:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7bd3179f-3a1b-47e1-8748-10ea66b7e781 tempest-CinderUnicodeTest-300199184 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.288s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:45:38 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-7bd3179f-3a1b-47e1-8748-10ea66b7e781 tempest-CinderUnicodeTest-300199184 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:45:38 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-7bd3179f-3a1b-47e1-8748-10ea66b7e781 tempest-CinderUnicodeTest-300199184 None] Deleted volume successfully. Nov 02 15:45:38 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7bd3179f-3a1b-47e1-8748-10ea66b7e781 tempest-CinderUnicodeTest-300199184 None] Lock "cinder-ea50e6b9-3c8e-4855-99ce-51c761cb5f02-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:45:48 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=78,cinder:UPDATE=99,cinder:INSERT=28,cinder:DELETE=7 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:45:48 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=74,cinder:UPDATE=93,cinder:DELETE=11,cinder:INSERT=24 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:46:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-93fe2c7b-5660-4ba6-8c69-4d7289e62839 req-e9c1ae49-ad41-42da-9d4e-e783ddfc1903 tempest-TestInstancesWithCinderVolumes-97825541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:46:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-93fe2c7b-5660-4ba6-8c69-4d7289e62839 req-e9c1ae49-ad41-42da-9d4e-e783ddfc1903 tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:46:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-93fe2c7b-5660-4ba6-8c69-4d7289e62839 req-e9c1ae49-ad41-42da-9d4e-e783ddfc1903 tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:46:07 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-93fe2c7b-5660-4ba6-8c69-4d7289e62839 req-e9c1ae49-ad41-42da-9d4e-e783ddfc1903 tempest-TestInstancesWithCinderVolumes-97825541 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478', 'name': 'volume-57faf504-2a96-4a40-9a05-8dc7f1f622de', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1764f1e6-0756-4f6d-a824-b2a99db75240', 'enforce_multipath': True} {{(pid=86703) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 15:46:07 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-93fe2c7b-5660-4ba6-8c69-4d7289e62839 req-e9c1ae49-ad41-42da-9d4e-e783ddfc1903 tempest-TestInstancesWithCinderVolumes-97825541 None] attachment_update completed successfully. Nov 02 15:46:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-5003818a-f011-4fde-b9a3-3acfc2ea749a req-6cd1f95b-475b-4faf-8d46-19d70976ed1e tempest-TestInstancesWithCinderVolumes-97825541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:46:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-5003818a-f011-4fde-b9a3-3acfc2ea749a req-6cd1f95b-475b-4faf-8d46-19d70976ed1e tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:46:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-5003818a-f011-4fde-b9a3-3acfc2ea749a req-6cd1f95b-475b-4faf-8d46-19d70976ed1e tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:46:09 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-5003818a-f011-4fde-b9a3-3acfc2ea749a req-6cd1f95b-475b-4faf-8d46-19d70976ed1e tempest-TestInstancesWithCinderVolumes-97825541 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478', 'name': 'volume-5724655a-9d85-4546-bb18-9cff9a5efe7b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '83d8c628-5f64-44cd-bac4-5ed0428ca667', 'enforce_multipath': True} {{(pid=86703) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 15:46:09 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-5003818a-f011-4fde-b9a3-3acfc2ea749a req-6cd1f95b-475b-4faf-8d46-19d70976ed1e tempest-TestInstancesWithCinderVolumes-97825541 None] attachment_update completed successfully. Nov 02 15:46:13 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-a63614ca-6e72-4749-9220-735c107bab3c req-d62a321e-c9a3-480a-b9f9-904a77ffea25 tempest-TestInstancesWithCinderVolumes-97825541 None] Terminate volume connection completed successfully. Nov 02 15:46:13 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-a63614ca-6e72-4749-9220-735c107bab3c req-d62a321e-c9a3-480a-b9f9-904a77ffea25 tempest-TestInstancesWithCinderVolumes-97825541 None] Deleting attachment 1764f1e6-0756-4f6d-a824-b2a99db75240. {{(pid=86703) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 15:46:14 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3eb1dea3-3af9-47dd-86ce-b1b1708e39b7 tempest-TestInstancesWithCinderVolumes-97825541 None] Acquiring lock "cinder-57faf504-2a96-4a40-9a05-8dc7f1f622de-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:46:14 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3eb1dea3-3af9-47dd-86ce-b1b1708e39b7 tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "cinder-57faf504-2a96-4a40-9a05-8dc7f1f622de-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:46:14 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3eb1dea3-3af9-47dd-86ce-b1b1708e39b7 tempest-TestInstancesWithCinderVolumes-97825541 None] Acquiring lock "cinder-quobyte-57faf504-2a96-4a40-9a05-8dc7f1f622de" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:46:14 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3eb1dea3-3af9-47dd-86ce-b1b1708e39b7 tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "cinder-quobyte-57faf504-2a96-4a40-9a05-8dc7f1f622de" acquired by "delete_volume" :: waited 0.014s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:46:14 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0b3c62-c43c-4f04-9059-4a433035f427]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:46:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3eb1dea3-3af9-47dd-86ce-b1b1708e39b7 tempest-TestInstancesWithCinderVolumes-97825541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-57faf504-2a96-4a40-9a05-8dc7f1f622de {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:46:15 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-57faf504-2a96-4a40-9a05-8dc7f1f622de Nov 02 15:46:15 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:46:15 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Nov 02 15:46:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3eb1dea3-3af9-47dd-86ce-b1b1708e39b7 tempest-TestInstancesWithCinderVolumes-97825541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-57faf504-2a96-4a40-9a05-8dc7f1f622de" returned: 0 in 0.395s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:46:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3eb1dea3-3af9-47dd-86ce-b1b1708e39b7 tempest-TestInstancesWithCinderVolumes-97825541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-57faf504-2a96-4a40-9a05-8dc7f1f622de {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:46:15 devstack sudo[105018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-57faf504-2a96-4a40-9a05-8dc7f1f622de Nov 02 15:46:15 devstack sudo[105018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:46:15 devstack sudo[105018]: pam_unix(sudo:session): session closed for user root Nov 02 15:46:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3eb1dea3-3af9-47dd-86ce-b1b1708e39b7 tempest-TestInstancesWithCinderVolumes-97825541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-57faf504-2a96-4a40-9a05-8dc7f1f622de" returned: 0 in 0.280s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:46:15 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3eb1dea3-3af9-47dd-86ce-b1b1708e39b7 tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "cinder-quobyte-57faf504-2a96-4a40-9a05-8dc7f1f622de" released by "delete_volume" :: held 0.729s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:46:15 devstack cinder-volume[86703]: WARNING cinder.quota [None req-3eb1dea3-3af9-47dd-86ce-b1b1708e39b7 tempest-TestInstancesWithCinderVolumes-97825541 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1770957435-1737347797 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1770957435-1737347797, it is now deprecated. Please use the default quota class for default quota. Nov 02 15:46:15 devstack cinder-volume[86703]: WARNING cinder.quota [None req-3eb1dea3-3af9-47dd-86ce-b1b1708e39b7 tempest-TestInstancesWithCinderVolumes-97825541 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1770957435-1737347797 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1770957435-1737347797, it is now deprecated. Please use the default quota class for default quota. Nov 02 15:46:15 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-3eb1dea3-3af9-47dd-86ce-b1b1708e39b7 tempest-TestInstancesWithCinderVolumes-97825541 None] Created reservations ['16bb05e2-845d-45aa-b43f-4fc3c8312772', '8e60ae03-e144-4980-98ba-c90367c2d0ab', '870ce927-e020-4057-989d-faf616156e14', 'aa939b79-a71d-4535-bd7a-e9300416888f'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:46:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-3eb1dea3-3af9-47dd-86ce-b1b1708e39b7 tempest-TestInstancesWithCinderVolumes-97825541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:46:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-3eb1dea3-3af9-47dd-86ce-b1b1708e39b7 tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:46:15 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-3eb1dea3-3af9-47dd-86ce-b1b1708e39b7 tempest-TestInstancesWithCinderVolumes-97825541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:46:15 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-3eb1dea3-3af9-47dd-86ce-b1b1708e39b7 tempest-TestInstancesWithCinderVolumes-97825541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:46:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-3eb1dea3-3af9-47dd-86ce-b1b1708e39b7 tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:46:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3eb1dea3-3af9-47dd-86ce-b1b1708e39b7 tempest-TestInstancesWithCinderVolumes-97825541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:46:15 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:46:15 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:46:16 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Nov 02 15:46:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3eb1dea3-3af9-47dd-86ce-b1b1708e39b7 tempest-TestInstancesWithCinderVolumes-97825541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.316s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:46:16 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-3eb1dea3-3af9-47dd-86ce-b1b1708e39b7 tempest-TestInstancesWithCinderVolumes-97825541 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:46:16 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-3eb1dea3-3af9-47dd-86ce-b1b1708e39b7 tempest-TestInstancesWithCinderVolumes-97825541 None] Deleted volume successfully. Nov 02 15:46:16 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3eb1dea3-3af9-47dd-86ce-b1b1708e39b7 tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "cinder-57faf504-2a96-4a40-9a05-8dc7f1f622de-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:46:18 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-fc9e053d-d337-457e-b948-f803b4dcd9af req-3c7963f0-c95c-4702-a588-565f4cb032a5 tempest-TestInstancesWithCinderVolumes-97825541 None] Terminate volume connection completed successfully. Nov 02 15:46:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-fc9e053d-d337-457e-b948-f803b4dcd9af req-3c7963f0-c95c-4702-a588-565f4cb032a5 tempest-TestInstancesWithCinderVolumes-97825541 None] Deleting attachment 83d8c628-5f64-44cd-bac4-5ed0428ca667. {{(pid=86703) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 15:46:19 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a682023a-5934-4e27-819b-63d98b3aa9dd tempest-TestInstancesWithCinderVolumes-97825541 None] Acquiring lock "cinder-5724655a-9d85-4546-bb18-9cff9a5efe7b-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:46:19 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a682023a-5934-4e27-819b-63d98b3aa9dd tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "cinder-5724655a-9d85-4546-bb18-9cff9a5efe7b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:46:19 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a682023a-5934-4e27-819b-63d98b3aa9dd tempest-TestInstancesWithCinderVolumes-97825541 None] Acquiring lock "cinder-quobyte-5724655a-9d85-4546-bb18-9cff9a5efe7b" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:46:19 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a682023a-5934-4e27-819b-63d98b3aa9dd tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "cinder-quobyte-5724655a-9d85-4546-bb18-9cff9a5efe7b" acquired by "delete_volume" :: waited 0.015s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:46:19 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c6b537-934b-4841-9ace-221b37c1745d]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:46:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a682023a-5934-4e27-819b-63d98b3aa9dd tempest-TestInstancesWithCinderVolumes-97825541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5724655a-9d85-4546-bb18-9cff9a5efe7b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:46:19 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5724655a-9d85-4546-bb18-9cff9a5efe7b Nov 02 15:46:19 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:46:20 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Nov 02 15:46:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a682023a-5934-4e27-819b-63d98b3aa9dd tempest-TestInstancesWithCinderVolumes-97825541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5724655a-9d85-4546-bb18-9cff9a5efe7b" returned: 0 in 0.391s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:46:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a682023a-5934-4e27-819b-63d98b3aa9dd tempest-TestInstancesWithCinderVolumes-97825541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5724655a-9d85-4546-bb18-9cff9a5efe7b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:46:20 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5724655a-9d85-4546-bb18-9cff9a5efe7b Nov 02 15:46:20 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:46:20 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Nov 02 15:46:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a682023a-5934-4e27-819b-63d98b3aa9dd tempest-TestInstancesWithCinderVolumes-97825541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5724655a-9d85-4546-bb18-9cff9a5efe7b" returned: 0 in 0.286s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:46:20 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a682023a-5934-4e27-819b-63d98b3aa9dd tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "cinder-quobyte-5724655a-9d85-4546-bb18-9cff9a5efe7b" released by "delete_volume" :: held 0.724s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:46:20 devstack cinder-volume[86703]: WARNING cinder.quota [None req-a682023a-5934-4e27-819b-63d98b3aa9dd tempest-TestInstancesWithCinderVolumes-97825541 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2043913774-1992571950 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2043913774-1992571950, it is now deprecated. Please use the default quota class for default quota. Nov 02 15:46:20 devstack cinder-volume[86703]: WARNING cinder.quota [None req-a682023a-5934-4e27-819b-63d98b3aa9dd tempest-TestInstancesWithCinderVolumes-97825541 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2043913774-1992571950 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2043913774-1992571950, it is now deprecated. Please use the default quota class for default quota. Nov 02 15:46:20 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-a682023a-5934-4e27-819b-63d98b3aa9dd tempest-TestInstancesWithCinderVolumes-97825541 None] Created reservations ['4c903aa8-848c-47b9-94cf-de55c78b7c93', '520ba82a-c214-498b-9c17-745c1a5d301d', '1d611f75-a6da-455c-8e3c-1bf38ef5c929', 'c5fa51b4-2b75-4001-bc02-d43085c85ac6'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:46:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a682023a-5934-4e27-819b-63d98b3aa9dd tempest-TestInstancesWithCinderVolumes-97825541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:46:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a682023a-5934-4e27-819b-63d98b3aa9dd tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:46:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-a682023a-5934-4e27-819b-63d98b3aa9dd tempest-TestInstancesWithCinderVolumes-97825541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:46:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-a682023a-5934-4e27-819b-63d98b3aa9dd tempest-TestInstancesWithCinderVolumes-97825541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:46:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a682023a-5934-4e27-819b-63d98b3aa9dd tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:46:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a682023a-5934-4e27-819b-63d98b3aa9dd tempest-TestInstancesWithCinderVolumes-97825541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:46:20 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:46:20 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:46:20 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:46:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:46:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:46:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:46:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:46:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:46:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:46:20 devstack sudo[105059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:46:20 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:46:20 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Nov 02 15:46:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a682023a-5934-4e27-819b-63d98b3aa9dd tempest-TestInstancesWithCinderVolumes-97825541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.382s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:46:20 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-a682023a-5934-4e27-819b-63d98b3aa9dd tempest-TestInstancesWithCinderVolumes-97825541 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:46:20 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-a682023a-5934-4e27-819b-63d98b3aa9dd tempest-TestInstancesWithCinderVolumes-97825541 None] Deleted volume successfully. Nov 02 15:46:21 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a682023a-5934-4e27-819b-63d98b3aa9dd tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "cinder-5724655a-9d85-4546-bb18-9cff9a5efe7b-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:46:21 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root Nov 02 15:46:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.384s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:46:21 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:46:21 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager._thread_info {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:46:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread count: 29 {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 15:46:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread info: [<_MainThread(MainThread, started 125876361756800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 15:46:23 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-947103dc-e4a0-49c2-9432-6c1ccc7df978 req-03ae0dfc-56f0-49d5-807b-5426f24bf91a tempest-TestInstancesWithCinderVolumes-97825541 None] Terminate volume connection completed successfully. Nov 02 15:46:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-947103dc-e4a0-49c2-9432-6c1ccc7df978 req-03ae0dfc-56f0-49d5-807b-5426f24bf91a tempest-TestInstancesWithCinderVolumes-97825541 None] Deleting attachment 4a478b56-9754-402c-b48b-7186c0ace8be. {{(pid=86703) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 15:46:24 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5e6334bd-44b8-411c-b7d0-29afb59c3725 tempest-TestInstancesWithCinderVolumes-97825541 None] Acquiring lock "cinder-f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:46:24 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5e6334bd-44b8-411c-b7d0-29afb59c3725 tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "cinder-f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:46:24 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5e6334bd-44b8-411c-b7d0-29afb59c3725 tempest-TestInstancesWithCinderVolumes-97825541 None] Acquiring lock "cinder-quobyte-f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:46:24 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5e6334bd-44b8-411c-b7d0-29afb59c3725 tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "cinder-quobyte-f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3" acquired by "delete_volume" :: waited 0.017s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:46:24 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5322e31d-3c51-44e0-b624-a34c5548bfeb]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:46:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5e6334bd-44b8-411c-b7d0-29afb59c3725 tempest-TestInstancesWithCinderVolumes-97825541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:46:25 devstack sudo[105090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3 Nov 02 15:46:25 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:46:25 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root Nov 02 15:46:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5e6334bd-44b8-411c-b7d0-29afb59c3725 tempest-TestInstancesWithCinderVolumes-97825541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3" returned: 0 in 0.352s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:46:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5e6334bd-44b8-411c-b7d0-29afb59c3725 tempest-TestInstancesWithCinderVolumes-97825541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:46:25 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3 Nov 02 15:46:25 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:46:25 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Nov 02 15:46:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5e6334bd-44b8-411c-b7d0-29afb59c3725 tempest-TestInstancesWithCinderVolumes-97825541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3" returned: 0 in 0.247s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:46:25 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5e6334bd-44b8-411c-b7d0-29afb59c3725 tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "cinder-quobyte-f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3" released by "delete_volume" :: held 0.639s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:46:25 devstack cinder-volume[86703]: WARNING cinder.quota [None req-5e6334bd-44b8-411c-b7d0-29afb59c3725 tempest-TestInstancesWithCinderVolumes-97825541 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1991221102-686344465 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1991221102-686344465, it is now deprecated. Please use the default quota class for default quota. Nov 02 15:46:25 devstack cinder-volume[86703]: WARNING cinder.quota [None req-5e6334bd-44b8-411c-b7d0-29afb59c3725 tempest-TestInstancesWithCinderVolumes-97825541 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1991221102-686344465 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1991221102-686344465, it is now deprecated. Please use the default quota class for default quota. Nov 02 15:46:25 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-5e6334bd-44b8-411c-b7d0-29afb59c3725 tempest-TestInstancesWithCinderVolumes-97825541 None] Created reservations ['ff78a133-5385-40f2-a15d-7d42dc9cf9ea', '4e1a2bb0-2047-4d99-925e-655446b58654', 'b9364771-f3aa-4ad1-be95-24561d3efc20', 'ac057e3a-e4ee-4572-9d0a-dedcc3614f11'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:46:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5e6334bd-44b8-411c-b7d0-29afb59c3725 tempest-TestInstancesWithCinderVolumes-97825541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:46:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5e6334bd-44b8-411c-b7d0-29afb59c3725 tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:46:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-5e6334bd-44b8-411c-b7d0-29afb59c3725 tempest-TestInstancesWithCinderVolumes-97825541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:46:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-5e6334bd-44b8-411c-b7d0-29afb59c3725 tempest-TestInstancesWithCinderVolumes-97825541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:46:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5e6334bd-44b8-411c-b7d0-29afb59c3725 tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:46:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5e6334bd-44b8-411c-b7d0-29afb59c3725 tempest-TestInstancesWithCinderVolumes-97825541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:46:25 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:46:25 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:46:25 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Nov 02 15:46:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5e6334bd-44b8-411c-b7d0-29afb59c3725 tempest-TestInstancesWithCinderVolumes-97825541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.236s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:46:25 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-5e6334bd-44b8-411c-b7d0-29afb59c3725 tempest-TestInstancesWithCinderVolumes-97825541 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:46:25 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-5e6334bd-44b8-411c-b7d0-29afb59c3725 tempest-TestInstancesWithCinderVolumes-97825541 None] Deleted volume successfully. Nov 02 15:46:25 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-5e6334bd-44b8-411c-b7d0-29afb59c3725 tempest-TestInstancesWithCinderVolumes-97825541 None] Lock "cinder-f17a8c8b-0a8c-43ce-9b92-1eab3a284ad3-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:46:35 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=31,cinder:UPDATE=28,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:46:35 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=32,cinder:UPDATE=27,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:47:07 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:47:07 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] Flow 'volume_create_manager' (ea6be4ef-0d79-4e52-a78b-99d0d5890449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:47:07 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7a32f67-6033-410b-817c-1c214956a50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:47:07 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7a32f67-6033-410b-817c-1c214956a50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1612675763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f192f6-086c-4e10-b77e-1b1ddc34b498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32868e95d4b041b290f624cdd78f89cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:47:08Z,use_quota=True,user_id='586b2f1d2f3b49a2a59098a8f5f85a5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:47:08 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee9ce0a8-5348-4b8d-8e8c-aaee6d9d5292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:47:08 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee9ce0a8-5348-4b8d-8e8c-aaee6d9d5292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:47:08 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da98b50d-15b9-412b-b0b1-bb7d45596298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:47:08 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da98b50d-15b9-412b-b0b1-bb7d45596298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2f192f6-086c-4e10-b77e-1b1ddc34b498', 'volume_name': 'volume-b2f192f6-086c-4e10-b77e-1b1ddc34b498', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:47:08 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69b2b2b5-6427-488e-bfca-5b5f4b33c058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:47:08 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69b2b2b5-6427-488e-bfca-5b5f4b33c058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:47:08 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ef21df-1f2d-4dea-9449-9558500d7aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:47:08 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] Volume b2f192f6-086c-4e10-b77e-1b1ddc34b498: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2f192f6-086c-4e10-b77e-1b1ddc34b498', 'volume_size': 1} Nov 02 15:47:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:47:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:47:08 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1612675763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2f192f6-086c-4e10-b77e-1b1ddc34b498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='32868e95d4b041b290f624cdd78f89cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:47:08Z,use_quota=True,user_id='586b2f1d2f3b49a2a59098a8f5f85a5c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:47:08 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] Creating volume b2f192f6-086c-4e10-b77e-1b1ddc34b498 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:47:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:47:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:47:08 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:47:08 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:47:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:47:08 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:47:08 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:47:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b2f192f6-086c-4e10-b77e-1b1ddc34b498 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:47:08 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b2f192f6-086c-4e10-b77e-1b1ddc34b498 1073741824 Nov 02 15:47:08 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:47:08 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Nov 02 15:47:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b2f192f6-086c-4e10-b77e-1b1ddc34b498 1073741824" returned: 0 in 0.413s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:47:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b2f192f6-086c-4e10-b77e-1b1ddc34b498 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:47:08 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b2f192f6-086c-4e10-b77e-1b1ddc34b498 Nov 02 15:47:08 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:47:08 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Nov 02 15:47:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b2f192f6-086c-4e10-b77e-1b1ddc34b498" returned: 0 in 0.244s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:47:08 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:47:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:47:08 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2ef21df-1f2d-4dea-9449-9558500d7aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2f192f6-086c-4e10-b77e-1b1ddc34b498', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:47:08 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a215b5c-ac45-467f-82a9-67da22667c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:47:08 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] Volume volume-b2f192f6-086c-4e10-b77e-1b1ddc34b498 (b2f192f6-086c-4e10-b77e-1b1ddc34b498): created successfully Nov 02 15:47:08 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a215b5c-ac45-467f-82a9-67da22667c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:47:08 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] Flow 'volume_create_manager' (ea6be4ef-0d79-4e52-a78b-99d0d5890449) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:47:08 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-2c15ca01-d561-4b30-a18e-1d3e110928ac tempest-TestMinimumBasicScenario-131994953 None] Created volume successfully. Nov 02 15:47:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-7b6efb14-e77a-4997-926b-80a87f0ee8ee req-c355f93c-2882-4bca-b5f1-37de8d26f212 tempest-TestMinimumBasicScenario-131994953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:47:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-7b6efb14-e77a-4997-926b-80a87f0ee8ee req-c355f93c-2882-4bca-b5f1-37de8d26f212 tempest-TestMinimumBasicScenario-131994953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:47:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [req-7b6efb14-e77a-4997-926b-80a87f0ee8ee req-c355f93c-2882-4bca-b5f1-37de8d26f212 tempest-TestMinimumBasicScenario-131994953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:47:09 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-7b6efb14-e77a-4997-926b-80a87f0ee8ee req-c355f93c-2882-4bca-b5f1-37de8d26f212 tempest-TestMinimumBasicScenario-131994953 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478', 'name': 'volume-b2f192f6-086c-4e10-b77e-1b1ddc34b498', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dddddf51-eb14-4087-a696-a30cb05ca9d9', 'enforce_multipath': True} {{(pid=86703) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 02 15:47:09 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-7b6efb14-e77a-4997-926b-80a87f0ee8ee req-c355f93c-2882-4bca-b5f1-37de8d26f212 tempest-TestMinimumBasicScenario-131994953 None] attachment_update completed successfully. Nov 02 15:47:19 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:47:19 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:47:20 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager._thread_info {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:47:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread count: 29 {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 15:47:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread info: [<_MainThread(MainThread, started 125876361756800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 15:47:55 devstack cinder-volume[86703]: INFO cinder.volume.manager [req-491f59c1-2845-4945-b98b-75800447651a req-3147be2b-114d-4fb5-8d80-e22df2680ffe tempest-TestMinimumBasicScenario-131994953 None] Terminate volume connection completed successfully. Nov 02 15:47:55 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [req-491f59c1-2845-4945-b98b-75800447651a req-3147be2b-114d-4fb5-8d80-e22df2680ffe tempest-TestMinimumBasicScenario-131994953 None] Deleting attachment dddddf51-eb14-4087-a696-a30cb05ca9d9. {{(pid=86703) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 02 15:47:56 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4fef58f9-60c2-4b0f-8179-6f1c084c0dae tempest-TestMinimumBasicScenario-131994953 None] Acquiring lock "cinder-b2f192f6-086c-4e10-b77e-1b1ddc34b498-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:47:56 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4fef58f9-60c2-4b0f-8179-6f1c084c0dae tempest-TestMinimumBasicScenario-131994953 None] Lock "cinder-b2f192f6-086c-4e10-b77e-1b1ddc34b498-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:47:56 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4fef58f9-60c2-4b0f-8179-6f1c084c0dae tempest-TestMinimumBasicScenario-131994953 None] Acquiring lock "cinder-quobyte-b2f192f6-086c-4e10-b77e-1b1ddc34b498" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:47:56 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4fef58f9-60c2-4b0f-8179-6f1c084c0dae tempest-TestMinimumBasicScenario-131994953 None] Lock "cinder-quobyte-b2f192f6-086c-4e10-b77e-1b1ddc34b498" acquired by "delete_volume" :: waited 0.015s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:47:56 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[396f782a-ec61-4c3e-bab3-c25753430584]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:47:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4fef58f9-60c2-4b0f-8179-6f1c084c0dae tempest-TestMinimumBasicScenario-131994953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b2f192f6-086c-4e10-b77e-1b1ddc34b498 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:47:56 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b2f192f6-086c-4e10-b77e-1b1ddc34b498 Nov 02 15:47:56 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:47:57 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Nov 02 15:47:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4fef58f9-60c2-4b0f-8179-6f1c084c0dae tempest-TestMinimumBasicScenario-131994953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b2f192f6-086c-4e10-b77e-1b1ddc34b498" returned: 0 in 0.342s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:47:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4fef58f9-60c2-4b0f-8179-6f1c084c0dae tempest-TestMinimumBasicScenario-131994953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b2f192f6-086c-4e10-b77e-1b1ddc34b498 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:47:57 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b2f192f6-086c-4e10-b77e-1b1ddc34b498 Nov 02 15:47:57 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:47:57 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Nov 02 15:47:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4fef58f9-60c2-4b0f-8179-6f1c084c0dae tempest-TestMinimumBasicScenario-131994953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b2f192f6-086c-4e10-b77e-1b1ddc34b498" returned: 0 in 0.265s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:47:57 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4fef58f9-60c2-4b0f-8179-6f1c084c0dae tempest-TestMinimumBasicScenario-131994953 None] Lock "cinder-quobyte-b2f192f6-086c-4e10-b77e-1b1ddc34b498" released by "delete_volume" :: held 0.645s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:47:57 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-4fef58f9-60c2-4b0f-8179-6f1c084c0dae tempest-TestMinimumBasicScenario-131994953 None] Created reservations ['7f414810-c49c-4223-ab66-6585d8e3ed84', '3d4ec181-041c-4473-8829-03f55ffa4347', '51d70c42-a496-4a9b-9097-a2d6cca2b3e3', 'cd4f8701-ec9b-493a-a7e0-0750152ecf67'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:47:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4fef58f9-60c2-4b0f-8179-6f1c084c0dae tempest-TestMinimumBasicScenario-131994953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:47:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4fef58f9-60c2-4b0f-8179-6f1c084c0dae tempest-TestMinimumBasicScenario-131994953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:47:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4fef58f9-60c2-4b0f-8179-6f1c084c0dae tempest-TestMinimumBasicScenario-131994953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:47:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4fef58f9-60c2-4b0f-8179-6f1c084c0dae tempest-TestMinimumBasicScenario-131994953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:47:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4fef58f9-60c2-4b0f-8179-6f1c084c0dae tempest-TestMinimumBasicScenario-131994953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:47:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4fef58f9-60c2-4b0f-8179-6f1c084c0dae tempest-TestMinimumBasicScenario-131994953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:47:57 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:47:57 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:47:57 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Nov 02 15:47:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4fef58f9-60c2-4b0f-8179-6f1c084c0dae tempest-TestMinimumBasicScenario-131994953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.230s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:47:57 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-4fef58f9-60c2-4b0f-8179-6f1c084c0dae tempest-TestMinimumBasicScenario-131994953 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:47:57 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-4fef58f9-60c2-4b0f-8179-6f1c084c0dae tempest-TestMinimumBasicScenario-131994953 None] Deleted volume successfully. Nov 02 15:47:57 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4fef58f9-60c2-4b0f-8179-6f1c084c0dae tempest-TestMinimumBasicScenario-131994953 None] Lock "cinder-b2f192f6-086c-4e10-b77e-1b1ddc34b498-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:48:14 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=6,cinder:INSERT=3,cinder:UPDATE=9 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:48:14 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=7,cinder:UPDATE=8,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:48:20 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:48:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:48:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:48:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:48:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:48:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:48:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:48:20 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:48:20 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:48:21 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Nov 02 15:48:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.342s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:48:21 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:48:21 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager._thread_info {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:48:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread count: 29 {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 15:48:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread info: [<_MainThread(MainThread, started 125876361756800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 15:48:31 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:48:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] Flow 'volume_create_manager' (b6664ad4-bd78-4886-b23b-9ea8d488a545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:48:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe8c8438-6290-4a97-b9ef-a2e4a69c4688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:48:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe8c8438-6290-4a97-b9ef-a2e4a69c4688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-297227717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d7e98baf90047cfb872d86c99c1593d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:48:31Z,use_quota=True,user_id='d17a67d7bb444fb4bc3c426a192489bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:48:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e5a6a9-1f68-4753-8dea-c6c3257eade3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:48:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4e5a6a9-1f68-4753-8dea-c6c3257eade3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:48:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21433f68-fc9e-4756-b679-b56f9483008a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:48:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21433f68-fc9e-4756-b679-b56f9483008a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0', 'volume_name': 'volume-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:48:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733b7e49-df07-4581-9838-dc6f42a2b550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:48:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (733b7e49-df07-4581-9838-dc6f42a2b550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:48:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (495cee2d-3963-4b1d-9660-8be269a94e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:48:31 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] Volume 1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0', 'volume_size': 1} Nov 02 15:48:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:48:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:48:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-297227717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d7e98baf90047cfb872d86c99c1593d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:48:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:48:31Z,use_quota=True,user_id='d17a67d7bb444fb4bc3c426a192489bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:48:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] Creating volume 1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:48:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:48:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:48:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:48:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:48:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:48:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:48:31 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:48:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:48:31 devstack sudo[105884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0 1073741824 Nov 02 15:48:31 devstack sudo[105884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:48:31 devstack sudo[105884]: pam_unix(sudo:session): session closed for user root Nov 02 15:48:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0 1073741824" returned: 0 in 0.413s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:48:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:48:32 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0 Nov 02 15:48:32 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:48:32 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Nov 02 15:48:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0" returned: 0 in 0.233s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:48:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:48:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:48:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (495cee2d-3963-4b1d-9660-8be269a94e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:48:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78b1cb87-5468-48c2-8612-46f93db05827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:48:32 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] Volume volume-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0 (1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0): created successfully Nov 02 15:48:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78b1cb87-5468-48c2-8612-46f93db05827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:48:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] Flow 'volume_create_manager' (b6664ad4-bd78-4886-b23b-9ea8d488a545) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:48:32 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-0b78b06f-889a-4357-83ab-9bc22ca4839b tempest-TestImageHashVerification-970824168 None] Created volume successfully. Nov 02 15:48:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d4cf4523-5ce1-4bc3-8566-5913a6a161ac tempest-TestImageHashVerification-970824168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:48:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d4cf4523-5ce1-4bc3-8566-5913a6a161ac tempest-TestImageHashVerification-970824168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:48:33 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8eaedd5-a295-405f-a799-27f46b202bb6]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:48:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d4cf4523-5ce1-4bc3-8566-5913a6a161ac tempest-TestImageHashVerification-970824168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:48:33 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0 Nov 02 15:48:33 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:48:33 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Nov 02 15:48:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d4cf4523-5ce1-4bc3-8566-5913a6a161ac tempest-TestImageHashVerification-970824168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0" returned: 0 in 0.352s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:48:33 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa6cc8b-cb81-4b37-9078-6a78fef39d65]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:48:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d4cf4523-5ce1-4bc3-8566-5913a6a161ac tempest-TestImageHashVerification-970824168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:48:33 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0 Nov 02 15:48:33 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:48:33 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Nov 02 15:48:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d4cf4523-5ce1-4bc3-8566-5913a6a161ac tempest-TestImageHashVerification-970824168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0" returned: 0 in 0.353s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:48:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d4cf4523-5ce1-4bc3-8566-5913a6a161ac tempest-TestImageHashVerification-970824168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0 /opt/stack/data/cinder/conversion/1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0.temp_image.20e13b6d-8885-48df-b5e9-ee48f80b3f0cc3279pfc.img {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:48:33 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0 /opt/stack/data/cinder/conversion/1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0.temp_image.20e13b6d-8885-48df-b5e9-ee48f80b3f0cc3279pfc.img Nov 02 15:48:33 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:48:39 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Nov 02 15:48:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d4cf4523-5ce1-4bc3-8566-5913a6a161ac tempest-TestImageHashVerification-970824168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0 /opt/stack/data/cinder/conversion/1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0.temp_image.20e13b6d-8885-48df-b5e9-ee48f80b3f0cc3279pfc.img" returned: 0 in 5.144s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:48:39 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3730bfee-d882-4658-9373-3407ab6a0482]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:48:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d4cf4523-5ce1-4bc3-8566-5913a6a161ac tempest-TestImageHashVerification-970824168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:48:39 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0 Nov 02 15:48:39 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:48:39 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Nov 02 15:48:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d4cf4523-5ce1-4bc3-8566-5913a6a161ac tempest-TestImageHashVerification-970824168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0" returned: 0 in 0.507s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:48:39 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-d4cf4523-5ce1-4bc3-8566-5913a6a161ac tempest-TestImageHashVerification-970824168 None] Image conversion details: src /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0, size 1024.00 MB, duration 5.15 sec, destination /opt/stack/data/cinder/conversion/1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0.temp_image.20e13b6d-8885-48df-b5e9-ee48f80b3f0cc3279pfc.img {{(pid=86703) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 15:48:39 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-d4cf4523-5ce1-4bc3-8566-5913a6a161ac tempest-TestImageHashVerification-970824168 None] Converted 1024.00 MB image at 198.98 MB/s Nov 02 15:48:39 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-d4cf4523-5ce1-4bc3-8566-5913a6a161ac tempest-TestImageHashVerification-970824168 None] 20e13b6d-8885-48df-b5e9-ee48f80b3f0c was raw, no need to convert to raw {{(pid=86703) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 02 15:48:43 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:UPDATE=5,cinder:SELECT=2,cinder:INSERT=1 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:48:49 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:48:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d4cf4523-5ce1-4bc3-8566-5913a6a161ac tempest-TestImageHashVerification-970824168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.709s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:48:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d4cf4523-5ce1-4bc3-8566-5913a6a161ac tempest-TestImageHashVerification-970824168 None] Uploaded volume to glance image-id: 20e13b6d-8885-48df-b5e9-ee48f80b3f0c. {{(pid=86703) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 02 15:48:57 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-d4cf4523-5ce1-4bc3-8566-5913a6a161ac tempest-TestImageHashVerification-970824168 None] Copy volume to image completed successfully. Nov 02 15:48:58 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ef79359d-2c62-4975-abd0-1d347ef20a9f tempest-TestImageHashVerification-970824168 None] Acquiring lock "cinder-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:48:58 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ef79359d-2c62-4975-abd0-1d347ef20a9f tempest-TestImageHashVerification-970824168 None] Lock "cinder-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:48:58 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ef79359d-2c62-4975-abd0-1d347ef20a9f tempest-TestImageHashVerification-970824168 None] Acquiring lock "cinder-quobyte-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:48:58 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ef79359d-2c62-4975-abd0-1d347ef20a9f tempest-TestImageHashVerification-970824168 None] Lock "cinder-quobyte-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0" acquired by "delete_volume" :: waited 0.017s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:48:58 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d54fe9d-e643-4ef9-950b-8aa71f90cf72]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:48:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ef79359d-2c62-4975-abd0-1d347ef20a9f tempest-TestImageHashVerification-970824168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:48:58 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0 Nov 02 15:48:58 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:48:58 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Nov 02 15:48:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ef79359d-2c62-4975-abd0-1d347ef20a9f tempest-TestImageHashVerification-970824168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0" returned: 0 in 0.348s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:48:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ef79359d-2c62-4975-abd0-1d347ef20a9f tempest-TestImageHashVerification-970824168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:48:58 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0 Nov 02 15:48:58 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:48:59 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Nov 02 15:48:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ef79359d-2c62-4975-abd0-1d347ef20a9f tempest-TestImageHashVerification-970824168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0" returned: 0 in 0.256s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:48:59 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ef79359d-2c62-4975-abd0-1d347ef20a9f tempest-TestImageHashVerification-970824168 None] Lock "cinder-quobyte-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0" released by "delete_volume" :: held 0.651s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:48:59 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-ef79359d-2c62-4975-abd0-1d347ef20a9f tempest-TestImageHashVerification-970824168 None] Created reservations ['c056a580-6a1c-48fb-949c-6a2a354510ee', 'e446f299-6c00-4077-8022-bba61e976834', '43763ff1-4b2a-4171-b0bb-d6fbdbec2cdb', '1da63303-4864-4040-93f8-a32c0ff1b990'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:48:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ef79359d-2c62-4975-abd0-1d347ef20a9f tempest-TestImageHashVerification-970824168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:48:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ef79359d-2c62-4975-abd0-1d347ef20a9f tempest-TestImageHashVerification-970824168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:48:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ef79359d-2c62-4975-abd0-1d347ef20a9f tempest-TestImageHashVerification-970824168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:48:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ef79359d-2c62-4975-abd0-1d347ef20a9f tempest-TestImageHashVerification-970824168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:48:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ef79359d-2c62-4975-abd0-1d347ef20a9f tempest-TestImageHashVerification-970824168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:48:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ef79359d-2c62-4975-abd0-1d347ef20a9f tempest-TestImageHashVerification-970824168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:48:59 devstack sudo[105969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:48:59 devstack sudo[105969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:48:59 devstack sudo[105969]: pam_unix(sudo:session): session closed for user root Nov 02 15:48:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ef79359d-2c62-4975-abd0-1d347ef20a9f tempest-TestImageHashVerification-970824168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.246s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:48:59 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-ef79359d-2c62-4975-abd0-1d347ef20a9f tempest-TestImageHashVerification-970824168 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:48:59 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-ef79359d-2c62-4975-abd0-1d347ef20a9f tempest-TestImageHashVerification-970824168 None] Deleted volume successfully. Nov 02 15:48:59 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ef79359d-2c62-4975-abd0-1d347ef20a9f tempest-TestImageHashVerification-970824168 None] Lock "cinder-1ec882df-1ba5-4ebc-9819-fcd6af5c3ee0-delete_volume" released by "delete_volume" :: held 1.115s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:49:09 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=5,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:49:09 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:UPDATE=8,cinder:SELECT=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:49:14 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:49:14 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Flow 'volume_create_manager' (4f67ab69-6d71-4be7-834f-04739684a1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:49:14 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32f0e9c9-8b69-48db-a913-ece0148944d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:14 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32f0e9c9-8b69-48db-a913-ece0148944d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a5bec18-8030-4c36-bc37-4d7b3d0b8d02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30bf81958f4f4cd0a5485957519c7242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:49:14Z,use_quota=True,user_id='311852d774384f0faf2b02979c107e8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9736a534-1d85-48ea-85c0-35cd708b3df9),volume_type_id=9736a534-1d85-48ea-85c0-35cd708b3df9)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:14 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd77af9e-2465-48e0-b820-9fb59097ece8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:14 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd77af9e-2465-48e0-b820-9fb59097ece8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:14 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7283ac8b-578e-44eb-8263-0c69728715fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:14 devstack cinder-volume[86703]: DEBUG cinder.image.glance [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Creating Keystone auth plugin from conf {{(pid=86703) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 15:49:14 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7283ac8b-578e-44eb-8263-0c69728715fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8a5bec18-8030-4c36-bc37-4d7b3d0b8d02', 'volume_name': 'volume-8a5bec18-8030-4c36-bc37-4d7b3d0b8d02', 'volume_size': 1, 'image_id': 'ff55fa92-cb82-4a2d-8ac5-38963f4426ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ff55fa92-cb82-4a2d-8ac5-38963f4426ea', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '78492203f07b41b53159bd2123b0aa4c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '30bf81958f4f4cd0a5485957519c7242', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '043b3649e9241c20f980c4d82a8487504e7376ea03bc61b1d07423da17ad76b181987d80ead844c882d28d8e8d39b672c822cb4811c3155296a2ba39d7bbaafd', 'id': 'ff55fa92-cb82-4a2d-8ac5-38963f4426ea', 'created_at': datetime.datetime(2026, 11, 2, 14, 49, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 14, 49, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ff55fa92-cb82-4a2d-8ac5-38963f4426ea/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:14 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a23e4a22-2b4f-417d-bc30-46b43f1a6510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:14 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a23e4a22-2b4f-417d-bc30-46b43f1a6510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:14 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea098086-92ee-40ef-aabb-02d93e83dbff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:14 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Volume 8a5bec18-8030-4c36-bc37-4d7b3d0b8d02: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8a5bec18-8030-4c36-bc37-4d7b3d0b8d02', 'volume_size': 1, 'image_id': 'ff55fa92-cb82-4a2d-8ac5-38963f4426ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ff55fa92-cb82-4a2d-8ac5-38963f4426ea', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '78492203f07b41b53159bd2123b0aa4c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '30bf81958f4f4cd0a5485957519c7242', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '043b3649e9241c20f980c4d82a8487504e7376ea03bc61b1d07423da17ad76b181987d80ead844c882d28d8e8d39b672c822cb4811c3155296a2ba39d7bbaafd', 'id': 'ff55fa92-cb82-4a2d-8ac5-38963f4426ea', 'created_at': datetime.datetime(2026, 11, 2, 14, 49, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 14, 49, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ff55fa92-cb82-4a2d-8ac5-38963f4426ea/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 02 15:49:14 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Trying to clone 8a5bec18-8030-4c36-bc37-4d7b3d0b8d02 from image ff55fa92-cb82-4a2d-8ac5-38963f4426ea at location (None, [{'url': 'file:///opt/stack/data/glance/images/ff55fa92-cb82-4a2d-8ac5-38963f4426ea', 'metadata': {}}]). {{(pid=86703) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 15:49:14 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ff55fa92-cb82-4a2d-8ac5-38963f4426ea_1lf6y5xndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86703) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 15:49:14 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Image download 0.00 MB at 0.00 MB/s Nov 02 15:49:14 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb9e109-83b5-4f3d-be42-c1263c63d2a5]: (4, 'raw') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:49:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff55fa92-cb82-4a2d-8ac5-38963f4426ea_1lf6y5xndevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:14 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff55fa92-cb82-4a2d-8ac5-38963f4426ea_1lf6y5xndevstack@QuobyteHD Nov 02 15:49:14 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:14 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff55fa92-cb82-4a2d-8ac5-38963f4426ea_1lf6y5xndevstack@QuobyteHD" returned: 0 in 0.321s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff55fa92-cb82-4a2d-8ac5-38963f4426ea_1lf6y5xndevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:14 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff55fa92-cb82-4a2d-8ac5-38963f4426ea_1lf6y5xndevstack@QuobyteHD Nov 02 15:49:14 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:15 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff55fa92-cb82-4a2d-8ac5-38963f4426ea_1lf6y5xndevstack@QuobyteHD" returned: 1 in 0.309s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff55fa92-cb82-4a2d-8ac5-38963f4426ea_1lf6y5xndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 15:49:15 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Temporary image ff55fa92-cb82-4a2d-8ac5-38963f4426ea is fetched for user 311852d774384f0faf2b02979c107e8d. {{(pid=86703) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 15:49:15 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f05648a-266c-46d8-a7db-93af278af1e3]: (4, 'raw') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:49:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff55fa92-cb82-4a2d-8ac5-38963f4426ea_1lf6y5xndevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:15 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff55fa92-cb82-4a2d-8ac5-38963f4426ea_1lf6y5xndevstack@QuobyteHD Nov 02 15:49:15 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:15 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff55fa92-cb82-4a2d-8ac5-38963f4426ea_1lf6y5xndevstack@QuobyteHD" returned: 0 in 0.302s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff55fa92-cb82-4a2d-8ac5-38963f4426ea_1lf6y5xndevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:15 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff55fa92-cb82-4a2d-8ac5-38963f4426ea_1lf6y5xndevstack@QuobyteHD Nov 02 15:49:15 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:15 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff55fa92-cb82-4a2d-8ac5-38963f4426ea_1lf6y5xndevstack@QuobyteHD" returned: 1 in 0.298s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff55fa92-cb82-4a2d-8ac5-38963f4426ea_1lf6y5xndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 15:49:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:49:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:49:15 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a5bec18-8030-4c36-bc37-4d7b3d0b8d02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30bf81958f4f4cd0a5485957519c7242',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:49:14Z,use_quota=True,user_id='311852d774384f0faf2b02979c107e8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9736a534-1d85-48ea-85c0-35cd708b3df9),volume_type_id=9736a534-1d85-48ea-85c0-35cd708b3df9)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:49:15 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Creating volume 8a5bec18-8030-4c36-bc37-4d7b3d0b8d02 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:49:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:49:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:49:15 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:49:15 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:49:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:49:15 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:49:15 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:49:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a5bec18-8030-4c36-bc37-4d7b3d0b8d02 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:15 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a5bec18-8030-4c36-bc37-4d7b3d0b8d02 1073741824 Nov 02 15:49:15 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:16 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a5bec18-8030-4c36-bc37-4d7b3d0b8d02 1073741824" returned: 0 in 0.432s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a5bec18-8030-4c36-bc37-4d7b3d0b8d02 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:16 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a5bec18-8030-4c36-bc37-4d7b3d0b8d02 Nov 02 15:49:16 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:16 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a5bec18-8030-4c36-bc37-4d7b3d0b8d02" returned: 0 in 0.244s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:16 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:49:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:49:16 devstack cinder-volume[86703]: DEBUG cinder.volume.volume_utils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Attempting download of ff55fa92-cb82-4a2d-8ac5-38963f4426ea ((None, [{'url': 'file:///opt/stack/data/glance/images/ff55fa92-cb82-4a2d-8ac5-38963f4426ea', 'metadata': {}}])) to volume 8a5bec18-8030-4c36-bc37-4d7b3d0b8d02. {{(pid=86703) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 15:49:16 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e84e8a-a852-4ccd-ac25-39e5f5b0490d]: (4, 'raw') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:49:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ff55fa92-cb82-4a2d-8ac5-38963f4426ea_sel30sjc {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:16 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ff55fa92-cb82-4a2d-8ac5-38963f4426ea_sel30sjc Nov 02 15:49:16 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:16 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ff55fa92-cb82-4a2d-8ac5-38963f4426ea_sel30sjc" returned: 0 in 0.345s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff55fa92-cb82-4a2d-8ac5-38963f4426ea_sel30sjc {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:17 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff55fa92-cb82-4a2d-8ac5-38963f4426ea_sel30sjc Nov 02 15:49:17 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:17 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff55fa92-cb82-4a2d-8ac5-38963f4426ea_sel30sjc" returned: 1 in 0.313s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ff55fa92-cb82-4a2d-8ac5-38963f4426ea_sel30sjc' failed. Not Retrying. {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 15:49:17 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7980024-3301-4c9a-916f-55b997476cc0]: (4, 'raw') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:49:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff55fa92-cb82-4a2d-8ac5-38963f4426ea_1lf6y5xndevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:17 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff55fa92-cb82-4a2d-8ac5-38963f4426ea_1lf6y5xndevstack@QuobyteHD Nov 02 15:49:17 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:17 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ff55fa92-cb82-4a2d-8ac5-38963f4426ea_1lf6y5xndevstack@QuobyteHD" returned: 0 in 0.313s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff55fa92-cb82-4a2d-8ac5-38963f4426ea_1lf6y5xndevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:17 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff55fa92-cb82-4a2d-8ac5-38963f4426ea_1lf6y5xndevstack@QuobyteHD Nov 02 15:49:17 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:17 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff55fa92-cb82-4a2d-8ac5-38963f4426ea_1lf6y5xndevstack@QuobyteHD" returned: 1 in 0.316s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ff55fa92-cb82-4a2d-8ac5-38963f4426ea_1lf6y5xndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 15:49:17 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] ff55fa92-cb82-4a2d-8ac5-38963f4426ea was raw, converting to qcow2 {{(pid=86703) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 15:49:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ff55fa92-cb82-4a2d-8ac5-38963f4426ea_1lf6y5xndevstack@QuobyteHD /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a5bec18-8030-4c36-bc37-4d7b3d0b8d02 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:17 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ff55fa92-cb82-4a2d-8ac5-38963f4426ea_1lf6y5xndevstack@QuobyteHD /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a5bec18-8030-4c36-bc37-4d7b3d0b8d02 Nov 02 15:49:17 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:18 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ff55fa92-cb82-4a2d-8ac5-38963f4426ea_1lf6y5xndevstack@QuobyteHD /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a5bec18-8030-4c36-bc37-4d7b3d0b8d02" returned: 0 in 0.414s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:18 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ff55fa92-cb82-4a2d-8ac5-38963f4426ea_1lf6y5xndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a5bec18-8030-4c36-bc37-4d7b3d0b8d02 {{(pid=86703) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 15:49:18 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 15:49:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a5bec18-8030-4c36-bc37-4d7b3d0b8d02 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:18 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a5bec18-8030-4c36-bc37-4d7b3d0b8d02 1G Nov 02 15:49:18 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:18 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a5bec18-8030-4c36-bc37-4d7b3d0b8d02 1G" returned: 0 in 0.303s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:18 devstack cinder-volume[86703]: DEBUG cinder.volume.volume_utils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Downloaded image ff55fa92-cb82-4a2d-8ac5-38963f4426ea ((None, [{'url': 'file:///opt/stack/data/glance/images/ff55fa92-cb82-4a2d-8ac5-38963f4426ea', 'metadata': {}}])) to volume 8a5bec18-8030-4c36-bc37-4d7b3d0b8d02 successfully. {{(pid=86703) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 15:49:18 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Temporary image ff55fa92-cb82-4a2d-8ac5-38963f4426ea for user 311852d774384f0faf2b02979c107e8d is deleted. {{(pid=86703) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 15:49:18 devstack cinder-volume[86703]: DEBUG cinder.volume.volume_utils [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Marking volume 8a5bec18-8030-4c36-bc37-4d7b3d0b8d02 as bootable. {{(pid=86703) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 15:49:18 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Copying metadata from image ff55fa92-cb82-4a2d-8ac5-38963f4426ea to 8a5bec18-8030-4c36-bc37-4d7b3d0b8d02. {{(pid=86703) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 15:49:18 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Creating volume glance metadata for volume 8a5bec18-8030-4c36-bc37-4d7b3d0b8d02 backed by image ff55fa92-cb82-4a2d-8ac5-38963f4426ea with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ff55fa92-cb82-4a2d-8ac5-38963f4426ea', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '78492203f07b41b53159bd2123b0aa4c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86703) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 15:49:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea098086-92ee-40ef-aabb-02d93e83dbff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a5bec18-8030-4c36-bc37-4d7b3d0b8d02', 'volume_size': 1, 'image_id': 'ff55fa92-cb82-4a2d-8ac5-38963f4426ea', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ff55fa92-cb82-4a2d-8ac5-38963f4426ea', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '78492203f07b41b53159bd2123b0aa4c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '30bf81958f4f4cd0a5485957519c7242', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '043b3649e9241c20f980c4d82a8487504e7376ea03bc61b1d07423da17ad76b181987d80ead844c882d28d8e8d39b672c822cb4811c3155296a2ba39d7bbaafd', 'id': 'ff55fa92-cb82-4a2d-8ac5-38963f4426ea', 'created_at': datetime.datetime(2026, 11, 2, 14, 49, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 14, 49, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ff55fa92-cb82-4a2d-8ac5-38963f4426ea/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71af8ab5-e23c-4c72-88cc-3f4651831fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:18 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Volume volume-8a5bec18-8030-4c36-bc37-4d7b3d0b8d02 (8a5bec18-8030-4c36-bc37-4d7b3d0b8d02): created successfully Nov 02 15:49:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71af8ab5-e23c-4c72-88cc-3f4651831fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Flow 'volume_create_manager' (4f67ab69-6d71-4be7-834f-04739684a1a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:49:18 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-98681500-9324-487a-bd1a-953d57682e33 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Created volume successfully. Nov 02 15:49:19 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-58557b09-a19b-4944-893f-ccd025a1a664 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Acquiring lock "cinder-8a5bec18-8030-4c36-bc37-4d7b3d0b8d02-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:49:19 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-58557b09-a19b-4944-893f-ccd025a1a664 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Lock "cinder-8a5bec18-8030-4c36-bc37-4d7b3d0b8d02-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:49:19 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-58557b09-a19b-4944-893f-ccd025a1a664 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Acquiring lock "cinder-quobyte-8a5bec18-8030-4c36-bc37-4d7b3d0b8d02" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:49:19 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-58557b09-a19b-4944-893f-ccd025a1a664 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Lock "cinder-quobyte-8a5bec18-8030-4c36-bc37-4d7b3d0b8d02" acquired by "delete_volume" :: waited 0.015s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:49:19 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[70108488-4a1e-47ed-8e50-63880be35677]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:49:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-58557b09-a19b-4944-893f-ccd025a1a664 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a5bec18-8030-4c36-bc37-4d7b3d0b8d02 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:19 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a5bec18-8030-4c36-bc37-4d7b3d0b8d02 Nov 02 15:49:19 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:19 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-58557b09-a19b-4944-893f-ccd025a1a664 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a5bec18-8030-4c36-bc37-4d7b3d0b8d02" returned: 0 in 0.360s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-58557b09-a19b-4944-893f-ccd025a1a664 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a5bec18-8030-4c36-bc37-4d7b3d0b8d02 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:19 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a5bec18-8030-4c36-bc37-4d7b3d0b8d02 Nov 02 15:49:19 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:20 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-58557b09-a19b-4944-893f-ccd025a1a664 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a5bec18-8030-4c36-bc37-4d7b3d0b8d02" returned: 0 in 0.247s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:20 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-58557b09-a19b-4944-893f-ccd025a1a664 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Lock "cinder-quobyte-8a5bec18-8030-4c36-bc37-4d7b3d0b8d02" released by "delete_volume" :: held 0.654s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:49:20 devstack cinder-volume[86703]: WARNING cinder.quota [None req-58557b09-a19b-4944-893f-ccd025a1a664 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 02 15:49:20 devstack cinder-volume[86703]: WARNING cinder.quota [None req-58557b09-a19b-4944-893f-ccd025a1a664 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 02 15:49:20 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-58557b09-a19b-4944-893f-ccd025a1a664 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Created reservations ['e8eb9737-9648-4163-9654-19ab063d4ad1', '94f39b0c-bea2-4a41-a869-3cf53f409625', '6a36c2bf-43bb-4cf1-8c75-ce783ff0afe4', 'eb4bb91d-a2d8-4549-bd25-ff61af741118'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:49:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-58557b09-a19b-4944-893f-ccd025a1a664 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:49:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-58557b09-a19b-4944-893f-ccd025a1a664 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:49:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-58557b09-a19b-4944-893f-ccd025a1a664 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:49:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-58557b09-a19b-4944-893f-ccd025a1a664 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:49:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-58557b09-a19b-4944-893f-ccd025a1a664 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:49:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-58557b09-a19b-4944-893f-ccd025a1a664 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:20 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:49:20 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:20 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-58557b09-a19b-4944-893f-ccd025a1a664 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.226s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:20 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-58557b09-a19b-4944-893f-ccd025a1a664 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:49:20 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-58557b09-a19b-4944-893f-ccd025a1a664 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Deleted volume successfully. Nov 02 15:49:20 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-58557b09-a19b-4944-893f-ccd025a1a664 tempest-VolumeAndVolumeTypeFromImageTest-1245549696 None] Lock "cinder-8a5bec18-8030-4c36-bc37-4d7b3d0b8d02-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:49:20 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:49:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:49:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:49:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:49:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:49:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:49:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:20 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:49:20 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:20 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.247s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:20 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:49:20 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager._thread_info {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:49:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread count: 29 {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 15:49:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread info: [<_MainThread(MainThread, started 125876361756800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 15:49:24 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:49:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] Flow 'volume_create_manager' (ce0de01d-111c-4da1-bcec-f367b108ebfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:49:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (962e17b7-99b5-4f18-b21f-fde8bc32a2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (962e17b7-99b5-4f18-b21f-fde8bc32a2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2123851323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebcadcde-d454-46a2-9f77-71a423d855bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c715f4c020ae432c9f1142206f781f55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:49:24Z,use_quota=True,user_id='6674dc8366154e26bc354e4f3dae7ec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf2ae78e-b771-4659-aaf9-1df14d135c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf2ae78e-b771-4659-aaf9-1df14d135c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f1ec38-37e3-41f7-aa5c-d72513ee6931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73f1ec38-37e3-41f7-aa5c-d72513ee6931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebcadcde-d454-46a2-9f77-71a423d855bd', 'volume_name': 'volume-ebcadcde-d454-46a2-9f77-71a423d855bd', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af2c45a-9cb4-4351-8f3b-b60d8ba12ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0af2c45a-9cb4-4351-8f3b-b60d8ba12ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2c1d67d-2912-4746-a2f0-440b265e182a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:24 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] Volume ebcadcde-d454-46a2-9f77-71a423d855bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebcadcde-d454-46a2-9f77-71a423d855bd', 'volume_size': 1} Nov 02 15:49:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:49:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:49:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:49:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2123851323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebcadcde-d454-46a2-9f77-71a423d855bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c715f4c020ae432c9f1142206f781f55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:49:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:49:24Z,use_quota=True,user_id='6674dc8366154e26bc354e4f3dae7ec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:49:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] Creating volume ebcadcde-d454-46a2-9f77-71a423d855bd {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:49:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:49:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:49:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:49:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:49:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:49:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:49:24 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:49:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:24 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd 1073741824 Nov 02 15:49:24 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:24 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd 1073741824" returned: 0 in 0.414s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:24 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd Nov 02 15:49:24 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:25 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd" returned: 0 in 0.235s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:49:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:49:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2c1d67d-2912-4746-a2f0-440b265e182a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebcadcde-d454-46a2-9f77-71a423d855bd', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (183bc96c-3b29-42f4-9ea2-337987a28335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:25 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] Volume volume-ebcadcde-d454-46a2-9f77-71a423d855bd (ebcadcde-d454-46a2-9f77-71a423d855bd): created successfully Nov 02 15:49:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (183bc96c-3b29-42f4-9ea2-337987a28335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] Flow 'volume_create_manager' (ce0de01d-111c-4da1-bcec-f367b108ebfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:49:25 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-88f9081a-576e-41fc-89d6-1ae5cd78ba7a tempest-CreateVolumesFromSnapshotTest-104138685 None] Created volume successfully. Nov 02 15:49:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-101b2eb2-1674-4b19-9ba5-760aef1b1f7b tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:49:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-101b2eb2-1674-4b19-9ba5-760aef1b1f7b tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:49:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-101b2eb2-1674-4b19-9ba5-760aef1b1f7b tempest-CreateVolumesFromSnapshotTest-104138685 None] Creating offline snapshot 10fe0f49-842f-45f3-b5c9-f5536441c10b of volume ebcadcde-d454-46a2-9f77-71a423d855bd {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:49:25 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ee5238-ff92-40ba-81f2-69c0bda5640f]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:49:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-101b2eb2-1674-4b19-9ba5-760aef1b1f7b tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:25 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd Nov 02 15:49:25 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:26 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-101b2eb2-1674-4b19-9ba5-760aef1b1f7b tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd" returned: 0 in 0.343s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-101b2eb2-1674-4b19-9ba5-760aef1b1f7b tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd.10fe0f49-842f-45f3-b5c9-f5536441c10b 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:26 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd.10fe0f49-842f-45f3-b5c9-f5536441c10b 1G Nov 02 15:49:26 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:26 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-101b2eb2-1674-4b19-9ba5-760aef1b1f7b tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd.10fe0f49-842f-45f3-b5c9-f5536441c10b 1G" returned: 0 in 0.357s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-101b2eb2-1674-4b19-9ba5-760aef1b1f7b tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebcadcde-d454-46a2-9f77-71a423d855bd -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd.10fe0f49-842f-45f3-b5c9-f5536441c10b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:26 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebcadcde-d454-46a2-9f77-71a423d855bd -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd.10fe0f49-842f-45f3-b5c9-f5536441c10b Nov 02 15:49:26 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:26 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-101b2eb2-1674-4b19-9ba5-760aef1b1f7b tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebcadcde-d454-46a2-9f77-71a423d855bd -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd.10fe0f49-842f-45f3-b5c9-f5536441c10b" returned: 0 in 0.287s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:26 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-101b2eb2-1674-4b19-9ba5-760aef1b1f7b tempest-CreateVolumesFromSnapshotTest-104138685 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd.10fe0f49-842f-45f3-b5c9-f5536441c10b is being set with open permissions: ugo+rw Nov 02 15:49:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-101b2eb2-1674-4b19-9ba5-760aef1b1f7b tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd.10fe0f49-842f-45f3-b5c9-f5536441c10b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:26 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd.10fe0f49-842f-45f3-b5c9-f5536441c10b Nov 02 15:49:26 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:26 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-101b2eb2-1674-4b19-9ba5-760aef1b1f7b tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd.10fe0f49-842f-45f3-b5c9-f5536441c10b" returned: 0 in 0.226s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-101b2eb2-1674-4b19-9ba5-760aef1b1f7b tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:26 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd.info Nov 02 15:49:26 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:27 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-101b2eb2-1674-4b19-9ba5-760aef1b1f7b tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd.info" returned: 0 in 0.233s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:27 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-101b2eb2-1674-4b19-9ba5-760aef1b1f7b tempest-CreateVolumesFromSnapshotTest-104138685 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd.info is being set with open permissions: ugo+rw Nov 02 15:49:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-101b2eb2-1674-4b19-9ba5-760aef1b1f7b tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:27 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd.info Nov 02 15:49:27 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:27 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-101b2eb2-1674-4b19-9ba5-760aef1b1f7b tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd.info" returned: 0 in 0.230s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-101b2eb2-1674-4b19-9ba5-760aef1b1f7b tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.758s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:49:27 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-101b2eb2-1674-4b19-9ba5-760aef1b1f7b tempest-CreateVolumesFromSnapshotTest-104138685 None] Create snapshot completed successfully Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] Flow 'volume_create_manager' (ee3d9232-100f-4f99-b7a5-e7544054fe32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68deb656-c068-4c97-a34a-a59bc6b942bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68deb656-c068-4c97-a34a-a59bc6b942bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2108937084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bc182ce-114b-4391-b256-17138553fbde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c715f4c020ae432c9f1142206f781f55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:49:28Z,use_quota=True,user_id='6674dc8366154e26bc354e4f3dae7ec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ede0829b-3961-4bd8-88f2-cd8c88069581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ede0829b-3961-4bd8-88f2-cd8c88069581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4063922-f756-483a-a127-961d98518978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4063922-f756-483a-a127-961d98518978) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bc182ce-114b-4391-b256-17138553fbde', 'volume_name': 'volume-5bc182ce-114b-4391-b256-17138553fbde', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f061768-852e-46ea-98e7-f6a38ca71a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f061768-852e-46ea-98e7-f6a38ca71a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e64b454f-1e9c-4ecf-8394-5896e4584296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:28 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] Volume 5bc182ce-114b-4391-b256-17138553fbde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bc182ce-114b-4391-b256-17138553fbde', 'volume_size': 1} Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2108937084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bc182ce-114b-4391-b256-17138553fbde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c715f4c020ae432c9f1142206f781f55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:49:28Z,use_quota=True,user_id='6674dc8366154e26bc354e4f3dae7ec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] Creating volume 5bc182ce-114b-4391-b256-17138553fbde {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:49:28 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5bc182ce-114b-4391-b256-17138553fbde 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:28 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5bc182ce-114b-4391-b256-17138553fbde 1073741824 Nov 02 15:49:28 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] Flow 'volume_create_manager' (06fe8409-0d78-44cf-8389-2fe8d9d72f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba63bb5-9586-4021-ad98-2fbf5eca5374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dba63bb5-9586-4021-ad98-2fbf5eca5374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-925380549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=294599d7-c789-4630-8ce1-66957c072046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c715f4c020ae432c9f1142206f781f55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:49:29Z,use_quota=True,user_id='6674dc8366154e26bc354e4f3dae7ec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a5daf15-f955-4579-95f1-01d9779efb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a5daf15-f955-4579-95f1-01d9779efb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83b07cbf-7b82-4dce-80af-fe752a5d8dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83b07cbf-7b82-4dce-80af-fe752a5d8dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '294599d7-c789-4630-8ce1-66957c072046', 'volume_name': 'volume-294599d7-c789-4630-8ce1-66957c072046', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a539394-1fc4-42bf-a05f-0f9d6abccc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a539394-1fc4-42bf-a05f-0f9d6abccc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f30a95-2bbe-438c-9eb6-f63b6a4bdd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:28 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] Volume 294599d7-c789-4630-8ce1-66957c072046: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-294599d7-c789-4630-8ce1-66957c072046', 'volume_size': 1} Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:49:28 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5bc182ce-114b-4391-b256-17138553fbde 1073741824" returned: 0 in 0.496s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5bc182ce-114b-4391-b256-17138553fbde {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:29 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5bc182ce-114b-4391-b256-17138553fbde Nov 02 15:49:29 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] Flow 'volume_create_manager' (6bc68f4f-da3b-42db-9efc-4cf077c49867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1cfdfb3-ceba-4d32-99d1-276645688603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1cfdfb3-ceba-4d32-99d1-276645688603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-628470697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f309d6e7-7a97-4234-9d23-1fe5b780b239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c715f4c020ae432c9f1142206f781f55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:49:29Z,use_quota=True,user_id='6674dc8366154e26bc354e4f3dae7ec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dc278f8-8f45-4c07-81a8-aaf5818aa01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dc278f8-8f45-4c07-81a8-aaf5818aa01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71174bbb-a084-4c17-9e00-d12fc9ef47ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71174bbb-a084-4c17-9e00-d12fc9ef47ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f309d6e7-7a97-4234-9d23-1fe5b780b239', 'volume_name': 'volume-f309d6e7-7a97-4234-9d23-1fe5b780b239', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c3c00a-a09e-4a09-9d05-fee872fd7d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c3c00a-a09e-4a09-9d05-fee872fd7d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b795e99e-2add-47f5-a72b-08ff10d5f879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:29 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] Volume f309d6e7-7a97-4234-9d23-1fe5b780b239: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f309d6e7-7a97-4234-9d23-1fe5b780b239', 'volume_size': 1} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:49:29 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5bc182ce-114b-4391-b256-17138553fbde" returned: 0 in 0.257s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.619s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-925380549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=294599d7-c789-4630-8ce1-66957c072046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c715f4c020ae432c9f1142206f781f55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:49:29Z,use_quota=True,user_id='6674dc8366154e26bc354e4f3dae7ec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] Creating volume 294599d7-c789-4630-8ce1-66957c072046 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:49:29 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-294599d7-c789-4630-8ce1-66957c072046 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:29 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-294599d7-c789-4630-8ce1-66957c072046 1073741824 Nov 02 15:49:29 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e64b454f-1e9c-4ecf-8394-5896e4584296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bc182ce-114b-4391-b256-17138553fbde', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e846fa4d-03ad-4bb2-a06e-f6521e4bcb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:29 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] Volume volume-5bc182ce-114b-4391-b256-17138553fbde (5bc182ce-114b-4391-b256-17138553fbde): created successfully Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e846fa4d-03ad-4bb2-a06e-f6521e4bcb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] Flow 'volume_create_manager' (ee3d9232-100f-4f99-b7a5-e7544054fe32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:49:29 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-c413ba9f-d901-4a1a-aea4-861dcff1f1b5 tempest-CreateVolumesFromSnapshotTest-104138685 None] Created volume successfully. Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] Flow 'volume_create_manager' (7b4b8876-71cd-4350-b535-9bfdc29632ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a63536-1e3b-4d15-a127-52d13300a2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1a63536-1e3b-4d15-a127-52d13300a2ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-111136953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcbd8cb2-7b41-4b79-9c0b-862bf367ba37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c715f4c020ae432c9f1142206f781f55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:49:29Z,use_quota=True,user_id='6674dc8366154e26bc354e4f3dae7ec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747a3ebf-c0bb-4326-91d9-c78f8b0f403b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (747a3ebf-c0bb-4326-91d9-c78f8b0f403b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45260b03-2823-4a34-96ac-01787cbe7b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45260b03-2823-4a34-96ac-01787cbe7b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcbd8cb2-7b41-4b79-9c0b-862bf367ba37', 'volume_name': 'volume-bcbd8cb2-7b41-4b79-9c0b-862bf367ba37', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4c5309-a6ea-4f72-b670-86c86b66f402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4c5309-a6ea-4f72-b670-86c86b66f402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce0d195f-7934-4583-a097-94e249015017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:29 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] Volume bcbd8cb2-7b41-4b79-9c0b-862bf367ba37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcbd8cb2-7b41-4b79-9c0b-862bf367ba37', 'volume_size': 1} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:49:29 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-294599d7-c789-4630-8ce1-66957c072046 1073741824" returned: 0 in 0.538s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] Flow 'volume_create_manager' (1cb87ec3-5b50-4587-ae1a-32d347001986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb54134-637f-4b33-a6ea-3a17d3354106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb54134-637f-4b33-a6ea-3a17d3354106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-147665029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2501569e-7ca2-4e69-9d36-d28a19d795d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c715f4c020ae432c9f1142206f781f55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:49:30Z,use_quota=True,user_id='6674dc8366154e26bc354e4f3dae7ec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd17ad7-58c7-4a97-9b12-6fb6f65dddbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd17ad7-58c7-4a97-9b12-6fb6f65dddbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbea01a7-2f4e-4b77-aedd-a67f8311b291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbea01a7-2f4e-4b77-aedd-a67f8311b291) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2501569e-7ca2-4e69-9d36-d28a19d795d7', 'volume_name': 'volume-2501569e-7ca2-4e69-9d36-d28a19d795d7', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (241a57da-ae26-4b21-9c9f-85108f8a6d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (241a57da-ae26-4b21-9c9f-85108f8a6d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e8941ce-790e-40a7-ae32-4a07f36487b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:29 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] Volume 2501569e-7ca2-4e69-9d36-d28a19d795d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2501569e-7ca2-4e69-9d36-d28a19d795d7', 'volume_size': 1} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:49:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-294599d7-c789-4630-8ce1-66957c072046 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:29 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-294599d7-c789-4630-8ce1-66957c072046 Nov 02 15:49:29 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:30 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-294599d7-c789-4630-8ce1-66957c072046" returned: 0 in 0.235s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.944s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-628470697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f309d6e7-7a97-4234-9d23-1fe5b780b239,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c715f4c020ae432c9f1142206f781f55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:49:29Z,use_quota=True,user_id='6674dc8366154e26bc354e4f3dae7ec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] Creating volume f309d6e7-7a97-4234-9d23-1fe5b780b239 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:49:30 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f309d6e7-7a97-4234-9d23-1fe5b780b239 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4f30a95-2bbe-438c-9eb6-f63b6a4bdd3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-294599d7-c789-4630-8ce1-66957c072046', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:30 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f309d6e7-7a97-4234-9d23-1fe5b780b239 1073741824 Nov 02 15:49:30 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec1eb6ad-bb0f-42ed-9528-86db5a4a4526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:30 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] Volume volume-294599d7-c789-4630-8ce1-66957c072046 (294599d7-c789-4630-8ce1-66957c072046): created successfully Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec1eb6ad-bb0f-42ed-9528-86db5a4a4526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] Flow 'volume_create_manager' (06fe8409-0d78-44cf-8389-2fe8d9d72f49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:49:30 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-ccd41d71-ceea-454b-a258-1a84b30e80e9 tempest-CreateVolumesFromSnapshotTest-104138685 None] Created volume successfully. Nov 02 15:49:30 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f309d6e7-7a97-4234-9d23-1fe5b780b239 1073741824" returned: 0 in 0.400s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f309d6e7-7a97-4234-9d23-1fe5b780b239 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:30 devstack sudo[106114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f309d6e7-7a97-4234-9d23-1fe5b780b239 Nov 02 15:49:30 devstack sudo[106114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:30 devstack sudo[106114]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f309d6e7-7a97-4234-9d23-1fe5b780b239" returned: 0 in 0.238s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.330s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:49:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-111136953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcbd8cb2-7b41-4b79-9c0b-862bf367ba37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c715f4c020ae432c9f1142206f781f55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:49:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:49:29Z,use_quota=True,user_id='6674dc8366154e26bc354e4f3dae7ec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] Creating volume bcbd8cb2-7b41-4b79-9c0b-862bf367ba37 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:49:30 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bcbd8cb2-7b41-4b79-9c0b-862bf367ba37 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b795e99e-2add-47f5-a72b-08ff10d5f879) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f309d6e7-7a97-4234-9d23-1fe5b780b239', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:30 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bcbd8cb2-7b41-4b79-9c0b-862bf367ba37 1073741824 Nov 02 15:49:30 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfaf1022-5b2b-4ce8-b7c6-245a2bd86bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:31 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] Volume volume-f309d6e7-7a97-4234-9d23-1fe5b780b239 (f309d6e7-7a97-4234-9d23-1fe5b780b239): created successfully Nov 02 15:49:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfaf1022-5b2b-4ce8-b7c6-245a2bd86bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] Flow 'volume_create_manager' (6bc68f4f-da3b-42db-9efc-4cf077c49867) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:49:31 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-ec424b7e-c85c-45a1-8a71-2a97433ee6a4 tempest-CreateVolumesFromSnapshotTest-104138685 None] Created volume successfully. Nov 02 15:49:31 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bcbd8cb2-7b41-4b79-9c0b-862bf367ba37 1073741824" returned: 0 in 0.404s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bcbd8cb2-7b41-4b79-9c0b-862bf367ba37 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:31 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bcbd8cb2-7b41-4b79-9c0b-862bf367ba37 Nov 02 15:49:31 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:31 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bcbd8cb2-7b41-4b79-9c0b-862bf367ba37" returned: 0 in 0.240s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:49:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:49:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.626s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:49:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-147665029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2501569e-7ca2-4e69-9d36-d28a19d795d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c715f4c020ae432c9f1142206f781f55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:49:30Z,use_quota=True,user_id='6674dc8366154e26bc354e4f3dae7ec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:49:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] Creating volume 2501569e-7ca2-4e69-9d36-d28a19d795d7 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:49:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:49:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:49:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:49:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:49:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:49:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:49:31 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:49:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2501569e-7ca2-4e69-9d36-d28a19d795d7 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:31 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2501569e-7ca2-4e69-9d36-d28a19d795d7 1073741824 Nov 02 15:49:31 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce0d195f-7934-4583-a097-94e249015017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcbd8cb2-7b41-4b79-9c0b-862bf367ba37', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c4cb49-b474-46d5-a644-b26c7cde351a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:31 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] Volume volume-bcbd8cb2-7b41-4b79-9c0b-862bf367ba37 (bcbd8cb2-7b41-4b79-9c0b-862bf367ba37): created successfully Nov 02 15:49:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c4cb49-b474-46d5-a644-b26c7cde351a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] Flow 'volume_create_manager' (7b4b8876-71cd-4350-b535-9bfdc29632ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:49:31 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-1acb7bf8-ecf1-4b73-ab09-e64788080cd8 tempest-CreateVolumesFromSnapshotTest-104138685 None] Created volume successfully. Nov 02 15:49:31 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2501569e-7ca2-4e69-9d36-d28a19d795d7 1073741824" returned: 0 in 0.399s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2501569e-7ca2-4e69-9d36-d28a19d795d7 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:32 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2501569e-7ca2-4e69-9d36-d28a19d795d7 Nov 02 15:49:32 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:32 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2501569e-7ca2-4e69-9d36-d28a19d795d7" returned: 0 in 0.240s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:49:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:49:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e8941ce-790e-40a7-ae32-4a07f36487b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2501569e-7ca2-4e69-9d36-d28a19d795d7', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a06a0297-3a52-47a3-8dc4-c104cc0c6a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:32 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] Volume volume-2501569e-7ca2-4e69-9d36-d28a19d795d7 (2501569e-7ca2-4e69-9d36-d28a19d795d7): created successfully Nov 02 15:49:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a06a0297-3a52-47a3-8dc4-c104cc0c6a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] Flow 'volume_create_manager' (1cb87ec3-5b50-4587-ae1a-32d347001986) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:49:32 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-fb8517f6-36c3-4fc1-8788-fe7517d15ec0 tempest-CreateVolumesFromSnapshotTest-104138685 None] Created volume successfully. Nov 02 15:49:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8c15ddd8-7d14-45e2-a7fb-a5c8a9f29a9c tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "cinder-2501569e-7ca2-4e69-9d36-d28a19d795d7-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:49:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8c15ddd8-7d14-45e2-a7fb-a5c8a9f29a9c tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "cinder-2501569e-7ca2-4e69-9d36-d28a19d795d7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:49:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8c15ddd8-7d14-45e2-a7fb-a5c8a9f29a9c tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "cinder-quobyte-2501569e-7ca2-4e69-9d36-d28a19d795d7" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:49:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8c15ddd8-7d14-45e2-a7fb-a5c8a9f29a9c tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "cinder-quobyte-2501569e-7ca2-4e69-9d36-d28a19d795d7" acquired by "delete_volume" :: waited 0.013s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:49:33 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ece3d9b-9223-4095-b423-146588f177ce]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:49:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8c15ddd8-7d14-45e2-a7fb-a5c8a9f29a9c tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2501569e-7ca2-4e69-9d36-d28a19d795d7 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:33 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2501569e-7ca2-4e69-9d36-d28a19d795d7 Nov 02 15:49:33 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:33 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8c15ddd8-7d14-45e2-a7fb-a5c8a9f29a9c tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2501569e-7ca2-4e69-9d36-d28a19d795d7" returned: 0 in 0.348s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8c15ddd8-7d14-45e2-a7fb-a5c8a9f29a9c tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2501569e-7ca2-4e69-9d36-d28a19d795d7 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:33 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2501569e-7ca2-4e69-9d36-d28a19d795d7 Nov 02 15:49:33 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:33 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8c15ddd8-7d14-45e2-a7fb-a5c8a9f29a9c tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2501569e-7ca2-4e69-9d36-d28a19d795d7" returned: 0 in 0.230s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8c15ddd8-7d14-45e2-a7fb-a5c8a9f29a9c tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "cinder-quobyte-2501569e-7ca2-4e69-9d36-d28a19d795d7" released by "delete_volume" :: held 0.618s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:49:33 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-8c15ddd8-7d14-45e2-a7fb-a5c8a9f29a9c tempest-CreateVolumesFromSnapshotTest-104138685 None] Created reservations ['b8e4556b-5b08-442f-a5ec-31724777c4b2', '2d871073-f891-4598-82f7-2130ec71f3fd', '1779ac31-6cc8-4461-8911-8fbce5124b83', 'a887df52-42b6-4de2-9170-e6bde245ee31'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:49:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8c15ddd8-7d14-45e2-a7fb-a5c8a9f29a9c tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:49:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8c15ddd8-7d14-45e2-a7fb-a5c8a9f29a9c tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:49:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8c15ddd8-7d14-45e2-a7fb-a5c8a9f29a9c tempest-CreateVolumesFromSnapshotTest-104138685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:49:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8c15ddd8-7d14-45e2-a7fb-a5c8a9f29a9c tempest-CreateVolumesFromSnapshotTest-104138685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:49:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8c15ddd8-7d14-45e2-a7fb-a5c8a9f29a9c tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:49:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8c15ddd8-7d14-45e2-a7fb-a5c8a9f29a9c tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:34 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:49:34 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:34 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8c15ddd8-7d14-45e2-a7fb-a5c8a9f29a9c tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.248s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:34 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-8c15ddd8-7d14-45e2-a7fb-a5c8a9f29a9c tempest-CreateVolumesFromSnapshotTest-104138685 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:49:34 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-8c15ddd8-7d14-45e2-a7fb-a5c8a9f29a9c tempest-CreateVolumesFromSnapshotTest-104138685 None] Deleted volume successfully. Nov 02 15:49:34 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8c15ddd8-7d14-45e2-a7fb-a5c8a9f29a9c tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "cinder-2501569e-7ca2-4e69-9d36-d28a19d795d7-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:49:34 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-de4eb87f-a9ce-4a96-a104-0aa2be0a9972 tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "cinder-bcbd8cb2-7b41-4b79-9c0b-862bf367ba37-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:49:34 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-de4eb87f-a9ce-4a96-a104-0aa2be0a9972 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "cinder-bcbd8cb2-7b41-4b79-9c0b-862bf367ba37-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:49:34 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-de4eb87f-a9ce-4a96-a104-0aa2be0a9972 tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "cinder-quobyte-bcbd8cb2-7b41-4b79-9c0b-862bf367ba37" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:49:34 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-de4eb87f-a9ce-4a96-a104-0aa2be0a9972 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "cinder-quobyte-bcbd8cb2-7b41-4b79-9c0b-862bf367ba37" acquired by "delete_volume" :: waited 0.019s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:49:34 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24a2317-05f1-4dc5-a705-bdd02ebe831d]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:49:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-de4eb87f-a9ce-4a96-a104-0aa2be0a9972 tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bcbd8cb2-7b41-4b79-9c0b-862bf367ba37 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:34 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bcbd8cb2-7b41-4b79-9c0b-862bf367ba37 Nov 02 15:49:34 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:34 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-de4eb87f-a9ce-4a96-a104-0aa2be0a9972 tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bcbd8cb2-7b41-4b79-9c0b-862bf367ba37" returned: 0 in 0.356s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-de4eb87f-a9ce-4a96-a104-0aa2be0a9972 tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bcbd8cb2-7b41-4b79-9c0b-862bf367ba37 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:34 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bcbd8cb2-7b41-4b79-9c0b-862bf367ba37 Nov 02 15:49:34 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:35 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-de4eb87f-a9ce-4a96-a104-0aa2be0a9972 tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-bcbd8cb2-7b41-4b79-9c0b-862bf367ba37" returned: 0 in 0.231s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-de4eb87f-a9ce-4a96-a104-0aa2be0a9972 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "cinder-quobyte-bcbd8cb2-7b41-4b79-9c0b-862bf367ba37" released by "delete_volume" :: held 0.628s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:49:35 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-de4eb87f-a9ce-4a96-a104-0aa2be0a9972 tempest-CreateVolumesFromSnapshotTest-104138685 None] Created reservations ['03398644-46e2-4d69-b121-87a4085dc43f', '2db73674-afe2-4e3a-9e02-f725bbf2cb97', 'd90bbd7d-202f-463a-9a83-3524c9ecf3a3', '9c150aaf-d280-4073-b665-39eb68a15793'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:49:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-de4eb87f-a9ce-4a96-a104-0aa2be0a9972 tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:49:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-de4eb87f-a9ce-4a96-a104-0aa2be0a9972 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:49:35 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-de4eb87f-a9ce-4a96-a104-0aa2be0a9972 tempest-CreateVolumesFromSnapshotTest-104138685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:49:35 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-de4eb87f-a9ce-4a96-a104-0aa2be0a9972 tempest-CreateVolumesFromSnapshotTest-104138685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:49:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-de4eb87f-a9ce-4a96-a104-0aa2be0a9972 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:49:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-de4eb87f-a9ce-4a96-a104-0aa2be0a9972 tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:35 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:49:35 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:35 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-de4eb87f-a9ce-4a96-a104-0aa2be0a9972 tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.234s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:35 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-de4eb87f-a9ce-4a96-a104-0aa2be0a9972 tempest-CreateVolumesFromSnapshotTest-104138685 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:49:35 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-de4eb87f-a9ce-4a96-a104-0aa2be0a9972 tempest-CreateVolumesFromSnapshotTest-104138685 None] Deleted volume successfully. Nov 02 15:49:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-de4eb87f-a9ce-4a96-a104-0aa2be0a9972 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "cinder-bcbd8cb2-7b41-4b79-9c0b-862bf367ba37-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:49:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-705b550e-0e68-4827-b3e0-42be45240f6e tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "cinder-f309d6e7-7a97-4234-9d23-1fe5b780b239-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:49:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-705b550e-0e68-4827-b3e0-42be45240f6e tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "cinder-f309d6e7-7a97-4234-9d23-1fe5b780b239-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:49:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-705b550e-0e68-4827-b3e0-42be45240f6e tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "cinder-quobyte-f309d6e7-7a97-4234-9d23-1fe5b780b239" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:49:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-705b550e-0e68-4827-b3e0-42be45240f6e tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "cinder-quobyte-f309d6e7-7a97-4234-9d23-1fe5b780b239" acquired by "delete_volume" :: waited 0.013s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:49:35 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b7005b-591d-4451-95e7-8129cfe83371]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:49:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-705b550e-0e68-4827-b3e0-42be45240f6e tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f309d6e7-7a97-4234-9d23-1fe5b780b239 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:35 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f309d6e7-7a97-4234-9d23-1fe5b780b239 Nov 02 15:49:35 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:35 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-705b550e-0e68-4827-b3e0-42be45240f6e tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f309d6e7-7a97-4234-9d23-1fe5b780b239" returned: 0 in 0.337s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-705b550e-0e68-4827-b3e0-42be45240f6e tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f309d6e7-7a97-4234-9d23-1fe5b780b239 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:35 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f309d6e7-7a97-4234-9d23-1fe5b780b239 Nov 02 15:49:35 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:36 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-705b550e-0e68-4827-b3e0-42be45240f6e tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f309d6e7-7a97-4234-9d23-1fe5b780b239" returned: 0 in 0.232s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-705b550e-0e68-4827-b3e0-42be45240f6e tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "cinder-quobyte-f309d6e7-7a97-4234-9d23-1fe5b780b239" released by "delete_volume" :: held 0.607s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:49:36 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-705b550e-0e68-4827-b3e0-42be45240f6e tempest-CreateVolumesFromSnapshotTest-104138685 None] Created reservations ['b7e3922e-af9b-4d17-a74b-2dbf34234722', '7f5ab56f-8be9-4f6f-9083-8d6ac0de366c', '1126e50f-6261-4977-9f70-d079672539b2', '0f174dba-f7dc-457d-86ab-cccc34c277df'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:49:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-705b550e-0e68-4827-b3e0-42be45240f6e tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:49:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-705b550e-0e68-4827-b3e0-42be45240f6e tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:49:36 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-705b550e-0e68-4827-b3e0-42be45240f6e tempest-CreateVolumesFromSnapshotTest-104138685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:49:36 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-705b550e-0e68-4827-b3e0-42be45240f6e tempest-CreateVolumesFromSnapshotTest-104138685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:49:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-705b550e-0e68-4827-b3e0-42be45240f6e tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:49:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-705b550e-0e68-4827-b3e0-42be45240f6e tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:36 devstack sudo[106164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:49:36 devstack sudo[106164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:36 devstack sudo[106164]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-705b550e-0e68-4827-b3e0-42be45240f6e tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.226s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:36 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-705b550e-0e68-4827-b3e0-42be45240f6e tempest-CreateVolumesFromSnapshotTest-104138685 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:49:36 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-705b550e-0e68-4827-b3e0-42be45240f6e tempest-CreateVolumesFromSnapshotTest-104138685 None] Deleted volume successfully. Nov 02 15:49:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-705b550e-0e68-4827-b3e0-42be45240f6e tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "cinder-f309d6e7-7a97-4234-9d23-1fe5b780b239-delete_volume" released by "delete_volume" :: held 1.024s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:49:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7ce0ec7e-e445-454e-9bad-6758ad2704c1 tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "cinder-294599d7-c789-4630-8ce1-66957c072046-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:49:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7ce0ec7e-e445-454e-9bad-6758ad2704c1 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "cinder-294599d7-c789-4630-8ce1-66957c072046-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:49:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7ce0ec7e-e445-454e-9bad-6758ad2704c1 tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "cinder-quobyte-294599d7-c789-4630-8ce1-66957c072046" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:49:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7ce0ec7e-e445-454e-9bad-6758ad2704c1 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "cinder-quobyte-294599d7-c789-4630-8ce1-66957c072046" acquired by "delete_volume" :: waited 0.013s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:49:36 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec38bd47-a966-4795-b455-6111277718b4]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:49:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7ce0ec7e-e445-454e-9bad-6758ad2704c1 tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-294599d7-c789-4630-8ce1-66957c072046 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:36 devstack sudo[106167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-294599d7-c789-4630-8ce1-66957c072046 Nov 02 15:49:36 devstack sudo[106167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:37 devstack sudo[106167]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7ce0ec7e-e445-454e-9bad-6758ad2704c1 tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-294599d7-c789-4630-8ce1-66957c072046" returned: 0 in 0.341s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7ce0ec7e-e445-454e-9bad-6758ad2704c1 tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-294599d7-c789-4630-8ce1-66957c072046 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:37 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-294599d7-c789-4630-8ce1-66957c072046 Nov 02 15:49:37 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:37 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7ce0ec7e-e445-454e-9bad-6758ad2704c1 tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-294599d7-c789-4630-8ce1-66957c072046" returned: 0 in 0.238s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:37 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7ce0ec7e-e445-454e-9bad-6758ad2704c1 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "cinder-quobyte-294599d7-c789-4630-8ce1-66957c072046" released by "delete_volume" :: held 0.620s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:49:37 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-7ce0ec7e-e445-454e-9bad-6758ad2704c1 tempest-CreateVolumesFromSnapshotTest-104138685 None] Created reservations ['d58f2990-0a2b-464a-b086-e840cdf9a66a', '03b6e969-a29a-4f42-aa58-f989152ad0f9', '755904d1-ddff-4de2-9404-3d5864141815', 'c8f386de-e25b-432c-9810-76333eba69fe'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:49:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7ce0ec7e-e445-454e-9bad-6758ad2704c1 tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:49:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7ce0ec7e-e445-454e-9bad-6758ad2704c1 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:49:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7ce0ec7e-e445-454e-9bad-6758ad2704c1 tempest-CreateVolumesFromSnapshotTest-104138685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:49:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7ce0ec7e-e445-454e-9bad-6758ad2704c1 tempest-CreateVolumesFromSnapshotTest-104138685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:49:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7ce0ec7e-e445-454e-9bad-6758ad2704c1 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:49:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7ce0ec7e-e445-454e-9bad-6758ad2704c1 tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:37 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:49:37 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:37 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7ce0ec7e-e445-454e-9bad-6758ad2704c1 tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.264s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:37 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-7ce0ec7e-e445-454e-9bad-6758ad2704c1 tempest-CreateVolumesFromSnapshotTest-104138685 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:49:37 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-7ce0ec7e-e445-454e-9bad-6758ad2704c1 tempest-CreateVolumesFromSnapshotTest-104138685 None] Deleted volume successfully. Nov 02 15:49:37 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7ce0ec7e-e445-454e-9bad-6758ad2704c1 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "cinder-294599d7-c789-4630-8ce1-66957c072046-delete_volume" released by "delete_volume" :: held 1.119s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:49:37 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-bcfeea2f-aa5f-489c-b857-92d2b6888287 tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "cinder-5bc182ce-114b-4391-b256-17138553fbde-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:49:37 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-bcfeea2f-aa5f-489c-b857-92d2b6888287 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "cinder-5bc182ce-114b-4391-b256-17138553fbde-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:49:37 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-bcfeea2f-aa5f-489c-b857-92d2b6888287 tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "cinder-quobyte-5bc182ce-114b-4391-b256-17138553fbde" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:49:37 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-bcfeea2f-aa5f-489c-b857-92d2b6888287 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "cinder-quobyte-5bc182ce-114b-4391-b256-17138553fbde" acquired by "delete_volume" :: waited 0.013s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:49:37 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b04e38-b8cd-4224-b19c-adeb4f25e94a]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:49:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bcfeea2f-aa5f-489c-b857-92d2b6888287 tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5bc182ce-114b-4391-b256-17138553fbde {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:38 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5bc182ce-114b-4391-b256-17138553fbde Nov 02 15:49:38 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:38 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bcfeea2f-aa5f-489c-b857-92d2b6888287 tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5bc182ce-114b-4391-b256-17138553fbde" returned: 0 in 0.340s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bcfeea2f-aa5f-489c-b857-92d2b6888287 tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5bc182ce-114b-4391-b256-17138553fbde {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:38 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5bc182ce-114b-4391-b256-17138553fbde Nov 02 15:49:38 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:38 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bcfeea2f-aa5f-489c-b857-92d2b6888287 tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5bc182ce-114b-4391-b256-17138553fbde" returned: 0 in 0.240s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:38 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-bcfeea2f-aa5f-489c-b857-92d2b6888287 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "cinder-quobyte-5bc182ce-114b-4391-b256-17138553fbde" released by "delete_volume" :: held 0.617s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:49:38 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-bcfeea2f-aa5f-489c-b857-92d2b6888287 tempest-CreateVolumesFromSnapshotTest-104138685 None] Created reservations ['4d47e72c-ded1-458c-9e2f-424ec2b2d27e', '5290f393-565e-4dde-9c79-7e30f10860ec', '341cdd4c-b8ce-4774-8980-70005885e382', '208e629d-8ad1-483a-91b3-3dcf365305e7'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:49:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-bcfeea2f-aa5f-489c-b857-92d2b6888287 tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:49:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-bcfeea2f-aa5f-489c-b857-92d2b6888287 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:49:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-bcfeea2f-aa5f-489c-b857-92d2b6888287 tempest-CreateVolumesFromSnapshotTest-104138685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:49:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-bcfeea2f-aa5f-489c-b857-92d2b6888287 tempest-CreateVolumesFromSnapshotTest-104138685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:49:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-bcfeea2f-aa5f-489c-b857-92d2b6888287 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:49:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bcfeea2f-aa5f-489c-b857-92d2b6888287 tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:38 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:49:38 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:38 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bcfeea2f-aa5f-489c-b857-92d2b6888287 tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.240s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:38 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-bcfeea2f-aa5f-489c-b857-92d2b6888287 tempest-CreateVolumesFromSnapshotTest-104138685 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:49:38 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-bcfeea2f-aa5f-489c-b857-92d2b6888287 tempest-CreateVolumesFromSnapshotTest-104138685 None] Deleted volume successfully. Nov 02 15:49:38 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-bcfeea2f-aa5f-489c-b857-92d2b6888287 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "cinder-5bc182ce-114b-4391-b256-17138553fbde-delete_volume" released by "delete_volume" :: held 1.047s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:49:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-cc532b9a-2ce2-4e54-9078-1a2d3866ad4f tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "cinder-10fe0f49-842f-45f3-b5c9-f5536441c10b-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:49:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-cc532b9a-2ce2-4e54-9078-1a2d3866ad4f tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "cinder-10fe0f49-842f-45f3-b5c9-f5536441c10b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:49:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-cc532b9a-2ce2-4e54-9078-1a2d3866ad4f tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "cinder-quobyte-ebcadcde-d454-46a2-9f77-71a423d855bd" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:49:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-cc532b9a-2ce2-4e54-9078-1a2d3866ad4f tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "cinder-quobyte-ebcadcde-d454-46a2-9f77-71a423d855bd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:49:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-cc532b9a-2ce2-4e54-9078-1a2d3866ad4f tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "cinder-quobyte-10fe0f49-842f-45f3-b5c9-f5536441c10b" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:49:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-cc532b9a-2ce2-4e54-9078-1a2d3866ad4f tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "cinder-quobyte-10fe0f49-842f-45f3-b5c9-f5536441c10b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:49:39 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-cc532b9a-2ce2-4e54-9078-1a2d3866ad4f tempest-CreateVolumesFromSnapshotTest-104138685 None] Deleting offline snapshot 10fe0f49-842f-45f3-b5c9-f5536441c10b of volume ebcadcde-d454-46a2-9f77-71a423d855bd {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:49:39 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-cc532b9a-2ce2-4e54-9078-1a2d3866ad4f tempest-CreateVolumesFromSnapshotTest-104138685 None] snapshot_file for this snap is: volume-ebcadcde-d454-46a2-9f77-71a423d855bd.10fe0f49-842f-45f3-b5c9-f5536441c10b {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:49:39 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcddb1d3-31d7-4567-8d26-4354de94c8ab]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:49:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cc532b9a-2ce2-4e54-9078-1a2d3866ad4f tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd.10fe0f49-842f-45f3-b5c9-f5536441c10b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:39 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd.10fe0f49-842f-45f3-b5c9-f5536441c10b Nov 02 15:49:39 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:39 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cc532b9a-2ce2-4e54-9078-1a2d3866ad4f tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd.10fe0f49-842f-45f3-b5c9-f5536441c10b" returned: 0 in 0.348s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:39 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-cc532b9a-2ce2-4e54-9078-1a2d3866ad4f tempest-CreateVolumesFromSnapshotTest-104138685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebcadcde-d454-46a2-9f77-71a423d855bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:49:39 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c5a14e-36d7-4728-9f72-090536430879]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:49:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cc532b9a-2ce2-4e54-9078-1a2d3866ad4f tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:39 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd Nov 02 15:49:39 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:39 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cc532b9a-2ce2-4e54-9078-1a2d3866ad4f tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd" returned: 0 in 0.337s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cc532b9a-2ce2-4e54-9078-1a2d3866ad4f tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd.10fe0f49-842f-45f3-b5c9-f5536441c10b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:39 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd.10fe0f49-842f-45f3-b5c9-f5536441c10b Nov 02 15:49:39 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:40 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cc532b9a-2ce2-4e54-9078-1a2d3866ad4f tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd.10fe0f49-842f-45f3-b5c9-f5536441c10b" returned: 0 in 0.306s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cc532b9a-2ce2-4e54-9078-1a2d3866ad4f tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd.10fe0f49-842f-45f3-b5c9-f5536441c10b {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:40 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd.10fe0f49-842f-45f3-b5c9-f5536441c10b Nov 02 15:49:40 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:40 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cc532b9a-2ce2-4e54-9078-1a2d3866ad4f tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd.10fe0f49-842f-45f3-b5c9-f5536441c10b" returned: 0 in 0.232s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-cc532b9a-2ce2-4e54-9078-1a2d3866ad4f tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "cinder-quobyte-10fe0f49-842f-45f3-b5c9-f5536441c10b" released by "_delete_snapshot" :: held 1.327s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:49:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-cc532b9a-2ce2-4e54-9078-1a2d3866ad4f tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "cinder-quobyte-ebcadcde-d454-46a2-9f77-71a423d855bd" released by "delete_snapshot" :: held 1.347s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:49:40 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-cc532b9a-2ce2-4e54-9078-1a2d3866ad4f tempest-CreateVolumesFromSnapshotTest-104138685 None] Created reservations ['c6eb5e45-72a0-4029-97be-9f42de88ea76', '12a57701-8cff-4d87-ad00-d9bd5854233a', 'aec60459-7ebd-48d7-8335-812eec017076', '42705eca-23e3-4756-bab2-46af17b86278'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:49:40 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-cc532b9a-2ce2-4e54-9078-1a2d3866ad4f tempest-CreateVolumesFromSnapshotTest-104138685 None] Delete snapshot completed successfully. Nov 02 15:49:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-cc532b9a-2ce2-4e54-9078-1a2d3866ad4f tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "cinder-10fe0f49-842f-45f3-b5c9-f5536441c10b-delete_snapshot" released by "delete_snapshot" :: held 1.474s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:49:41 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b8273c12-f59c-4be6-a3d6-dd6b84558a34 tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "cinder-ebcadcde-d454-46a2-9f77-71a423d855bd-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:49:41 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b8273c12-f59c-4be6-a3d6-dd6b84558a34 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "cinder-ebcadcde-d454-46a2-9f77-71a423d855bd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:49:41 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b8273c12-f59c-4be6-a3d6-dd6b84558a34 tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "cinder-quobyte-ebcadcde-d454-46a2-9f77-71a423d855bd" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:49:41 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b8273c12-f59c-4be6-a3d6-dd6b84558a34 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "cinder-quobyte-ebcadcde-d454-46a2-9f77-71a423d855bd" acquired by "delete_volume" :: waited 0.015s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:49:41 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[718f8d52-425a-48f8-996d-e5005edcad16]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:49:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b8273c12-f59c-4be6-a3d6-dd6b84558a34 tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:41 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd Nov 02 15:49:41 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:41 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b8273c12-f59c-4be6-a3d6-dd6b84558a34 tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd" returned: 0 in 0.340s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b8273c12-f59c-4be6-a3d6-dd6b84558a34 tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:41 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd Nov 02 15:49:41 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:41 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b8273c12-f59c-4be6-a3d6-dd6b84558a34 tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ebcadcde-d454-46a2-9f77-71a423d855bd" returned: 0 in 0.248s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:41 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b8273c12-f59c-4be6-a3d6-dd6b84558a34 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "cinder-quobyte-ebcadcde-d454-46a2-9f77-71a423d855bd" released by "delete_volume" :: held 0.642s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:49:41 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-b8273c12-f59c-4be6-a3d6-dd6b84558a34 tempest-CreateVolumesFromSnapshotTest-104138685 None] Created reservations ['92f9c2b5-fbf4-4100-b378-b50dda30ce4b', '5f45c789-486e-4f8a-8cf0-60e63e4b17be', 'da65138c-8d71-41c7-a359-4a86f41a2b56', '6ec79de0-4a32-4eda-ac20-c6dba6d549b2'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:49:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b8273c12-f59c-4be6-a3d6-dd6b84558a34 tempest-CreateVolumesFromSnapshotTest-104138685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:49:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b8273c12-f59c-4be6-a3d6-dd6b84558a34 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:49:41 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b8273c12-f59c-4be6-a3d6-dd6b84558a34 tempest-CreateVolumesFromSnapshotTest-104138685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:49:41 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b8273c12-f59c-4be6-a3d6-dd6b84558a34 tempest-CreateVolumesFromSnapshotTest-104138685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:49:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b8273c12-f59c-4be6-a3d6-dd6b84558a34 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:49:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b8273c12-f59c-4be6-a3d6-dd6b84558a34 tempest-CreateVolumesFromSnapshotTest-104138685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:42 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:49:42 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:42 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b8273c12-f59c-4be6-a3d6-dd6b84558a34 tempest-CreateVolumesFromSnapshotTest-104138685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.227s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:42 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-b8273c12-f59c-4be6-a3d6-dd6b84558a34 tempest-CreateVolumesFromSnapshotTest-104138685 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:49:42 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-b8273c12-f59c-4be6-a3d6-dd6b84558a34 tempest-CreateVolumesFromSnapshotTest-104138685 None] Deleted volume successfully. Nov 02 15:49:42 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b8273c12-f59c-4be6-a3d6-dd6b84558a34 tempest-CreateVolumesFromSnapshotTest-104138685 None] Lock "cinder-ebcadcde-d454-46a2-9f77-71a423d855bd-delete_volume" released by "delete_volume" :: held 1.154s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:49:47 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:49:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Flow 'volume_create_manager' (d6f94220-8df0-4e71-8f62-b88e4cde0546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:49:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd983d6a-efbd-4f0a-bc5b-30f310fea712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd983d6a-efbd-4f0a-bc5b-30f310fea712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b24f3fd-02dc-42ba-ab2c-fa31fa059830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edbc1337ab684b08a9589eaa26cc97bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:49:47Z,use_quota=True,user_id='96d632fe67154d059fa1844e8fcd6ccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3f279d9-62f0-4320-8e81-b6567a22d8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3f279d9-62f0-4320-8e81-b6567a22d8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e58f294-7baa-436a-992f-d06707b6802a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:47 devstack cinder-volume[86703]: DEBUG cinder.image.glance [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Creating Keystone auth plugin from conf {{(pid=86703) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 15:49:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e58f294-7baa-436a-992f-d06707b6802a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9b24f3fd-02dc-42ba-ab2c-fa31fa059830', 'volume_name': 'volume-9b24f3fd-02dc-42ba-ab2c-fa31fa059830', 'volume_size': 1, 'image_id': '24de6a15-160a-43ff-9850-07708cdb3a13', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24de6a15-160a-43ff-9850-07708cdb3a13', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '494af7ef5f832f65caf4a8ed4876d30a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'edbc1337ab684b08a9589eaa26cc97bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd2c43cd23f17b6ffb020479ba93cece0da4b470c4b4c7e76c4c6e709d038decf8590b427cad701833f7edd6c1e2c5e14c361b9a16a9f40b580dd3bff22bfb3e6', 'id': '24de6a15-160a-43ff-9850-07708cdb3a13', 'created_at': datetime.datetime(2026, 11, 2, 14, 49, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 14, 49, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24de6a15-160a-43ff-9850-07708cdb3a13/file', 'properties': {}}, 'image_service': }' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dbe6908-1625-4e94-86c1-d7bf6f785924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dbe6908-1625-4e94-86c1-d7bf6f785924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (434bf618-9338-4bed-8155-d1d9b45a1679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:47 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Volume 9b24f3fd-02dc-42ba-ab2c-fa31fa059830: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9b24f3fd-02dc-42ba-ab2c-fa31fa059830', 'volume_size': 1, 'image_id': '24de6a15-160a-43ff-9850-07708cdb3a13', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24de6a15-160a-43ff-9850-07708cdb3a13', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '494af7ef5f832f65caf4a8ed4876d30a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'edbc1337ab684b08a9589eaa26cc97bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd2c43cd23f17b6ffb020479ba93cece0da4b470c4b4c7e76c4c6e709d038decf8590b427cad701833f7edd6c1e2c5e14c361b9a16a9f40b580dd3bff22bfb3e6', 'id': '24de6a15-160a-43ff-9850-07708cdb3a13', 'created_at': datetime.datetime(2026, 11, 2, 14, 49, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 14, 49, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24de6a15-160a-43ff-9850-07708cdb3a13/file', 'properties': {}}, 'image_service': } Nov 02 15:49:47 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Trying to clone 9b24f3fd-02dc-42ba-ab2c-fa31fa059830 from image 24de6a15-160a-43ff-9850-07708cdb3a13 at location (None, [{'url': 'file:///opt/stack/data/glance/images/24de6a15-160a-43ff-9850-07708cdb3a13', 'metadata': {}}]). {{(pid=86703) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 15:49:47 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_24de6a15-160a-43ff-9850-07708cdb3a13_gw0agmbvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86703) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 15:49:47 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Image download 0.00 MB at 0.00 MB/s Nov 02 15:49:47 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8811c6c-c37a-45e5-bf37-b77fee537f51]: (4, 'raw') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:49:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24de6a15-160a-43ff-9850-07708cdb3a13_gw0agmbvdevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:47 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24de6a15-160a-43ff-9850-07708cdb3a13_gw0agmbvdevstack@QuobyteHD Nov 02 15:49:47 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:48 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24de6a15-160a-43ff-9850-07708cdb3a13_gw0agmbvdevstack@QuobyteHD" returned: 0 in 0.312s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24de6a15-160a-43ff-9850-07708cdb3a13_gw0agmbvdevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:48 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24de6a15-160a-43ff-9850-07708cdb3a13_gw0agmbvdevstack@QuobyteHD Nov 02 15:49:48 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:48 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24de6a15-160a-43ff-9850-07708cdb3a13_gw0agmbvdevstack@QuobyteHD" returned: 1 in 0.307s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24de6a15-160a-43ff-9850-07708cdb3a13_gw0agmbvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 15:49:48 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Temporary image 24de6a15-160a-43ff-9850-07708cdb3a13 is fetched for user 96d632fe67154d059fa1844e8fcd6ccd. {{(pid=86703) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 15:49:48 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a81b2d-493f-4875-9111-45cadba610b0]: (4, 'raw') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:49:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24de6a15-160a-43ff-9850-07708cdb3a13_gw0agmbvdevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:48 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24de6a15-160a-43ff-9850-07708cdb3a13_gw0agmbvdevstack@QuobyteHD Nov 02 15:49:48 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:48 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24de6a15-160a-43ff-9850-07708cdb3a13_gw0agmbvdevstack@QuobyteHD" returned: 0 in 0.299s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24de6a15-160a-43ff-9850-07708cdb3a13_gw0agmbvdevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:48 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24de6a15-160a-43ff-9850-07708cdb3a13_gw0agmbvdevstack@QuobyteHD Nov 02 15:49:48 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:49 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24de6a15-160a-43ff-9850-07708cdb3a13_gw0agmbvdevstack@QuobyteHD" returned: 1 in 0.297s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24de6a15-160a-43ff-9850-07708cdb3a13_gw0agmbvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 15:49:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:49:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:49:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:49:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b24f3fd-02dc-42ba-ab2c-fa31fa059830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edbc1337ab684b08a9589eaa26cc97bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:49:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:49:47Z,use_quota=True,user_id='96d632fe67154d059fa1844e8fcd6ccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:49:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Creating volume 9b24f3fd-02dc-42ba-ab2c-fa31fa059830 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:49:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:49:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:49:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:49:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:49:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:49:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:49:49 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:49:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9b24f3fd-02dc-42ba-ab2c-fa31fa059830 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:49 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9b24f3fd-02dc-42ba-ab2c-fa31fa059830 1073741824 Nov 02 15:49:49 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:49 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9b24f3fd-02dc-42ba-ab2c-fa31fa059830 1073741824" returned: 0 in 0.401s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9b24f3fd-02dc-42ba-ab2c-fa31fa059830 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:49 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9b24f3fd-02dc-42ba-ab2c-fa31fa059830 Nov 02 15:49:49 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:49 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9b24f3fd-02dc-42ba-ab2c-fa31fa059830" returned: 0 in 0.226s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] <== create_volume: return (665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:49:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.668s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:49:49 devstack cinder-volume[86703]: DEBUG cinder.volume.volume_utils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Attempting download of 24de6a15-160a-43ff-9850-07708cdb3a13 ((None, [{'url': 'file:///opt/stack/data/glance/images/24de6a15-160a-43ff-9850-07708cdb3a13', 'metadata': {}}])) to volume 9b24f3fd-02dc-42ba-ab2c-fa31fa059830. {{(pid=86703) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 15:49:49 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd1e5835-17b8-45a8-8880-8330687c89d0]: (4, 'raw') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:49:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24de6a15-160a-43ff-9850-07708cdb3a13_64nn4eji {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:50 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24de6a15-160a-43ff-9850-07708cdb3a13_64nn4eji Nov 02 15:49:50 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:50 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_24de6a15-160a-43ff-9850-07708cdb3a13_64nn4eji" returned: 0 in 0.298s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24de6a15-160a-43ff-9850-07708cdb3a13_64nn4eji {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:50 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24de6a15-160a-43ff-9850-07708cdb3a13_64nn4eji Nov 02 15:49:50 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:50 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24de6a15-160a-43ff-9850-07708cdb3a13_64nn4eji" returned: 1 in 0.297s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_24de6a15-160a-43ff-9850-07708cdb3a13_64nn4eji' failed. Not Retrying. {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 15:49:50 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75b775e-a649-4349-8c47-5638153d32dc]: (4, 'raw') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:49:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24de6a15-160a-43ff-9850-07708cdb3a13_gw0agmbvdevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:50 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24de6a15-160a-43ff-9850-07708cdb3a13_gw0agmbvdevstack@QuobyteHD Nov 02 15:49:50 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:50 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_24de6a15-160a-43ff-9850-07708cdb3a13_gw0agmbvdevstack@QuobyteHD" returned: 0 in 0.314s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24de6a15-160a-43ff-9850-07708cdb3a13_gw0agmbvdevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:50 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24de6a15-160a-43ff-9850-07708cdb3a13_gw0agmbvdevstack@QuobyteHD Nov 02 15:49:50 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:51 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24de6a15-160a-43ff-9850-07708cdb3a13_gw0agmbvdevstack@QuobyteHD" returned: 1 in 0.307s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_24de6a15-160a-43ff-9850-07708cdb3a13_gw0agmbvdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 15:49:51 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] 24de6a15-160a-43ff-9850-07708cdb3a13 was raw, converting to qcow2 {{(pid=86703) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 15:49:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_24de6a15-160a-43ff-9850-07708cdb3a13_gw0agmbvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9b24f3fd-02dc-42ba-ab2c-fa31fa059830 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:51 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_24de6a15-160a-43ff-9850-07708cdb3a13_gw0agmbvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9b24f3fd-02dc-42ba-ab2c-fa31fa059830 Nov 02 15:49:51 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:51 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_24de6a15-160a-43ff-9850-07708cdb3a13_gw0agmbvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9b24f3fd-02dc-42ba-ab2c-fa31fa059830" returned: 0 in 0.418s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:51 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_24de6a15-160a-43ff-9850-07708cdb3a13_gw0agmbvdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9b24f3fd-02dc-42ba-ab2c-fa31fa059830 {{(pid=86703) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 15:49:51 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 15:49:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9b24f3fd-02dc-42ba-ab2c-fa31fa059830 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:51 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9b24f3fd-02dc-42ba-ab2c-fa31fa059830 1G Nov 02 15:49:51 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:51 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9b24f3fd-02dc-42ba-ab2c-fa31fa059830 1G" returned: 0 in 0.311s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:51 devstack cinder-volume[86703]: DEBUG cinder.volume.volume_utils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Downloaded image 24de6a15-160a-43ff-9850-07708cdb3a13 ((None, [{'url': 'file:///opt/stack/data/glance/images/24de6a15-160a-43ff-9850-07708cdb3a13', 'metadata': {}}])) to volume 9b24f3fd-02dc-42ba-ab2c-fa31fa059830 successfully. {{(pid=86703) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 15:49:51 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Temporary image 24de6a15-160a-43ff-9850-07708cdb3a13 for user 96d632fe67154d059fa1844e8fcd6ccd is deleted. {{(pid=86703) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 15:49:51 devstack cinder-volume[86703]: DEBUG cinder.volume.volume_utils [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Marking volume 9b24f3fd-02dc-42ba-ab2c-fa31fa059830 as bootable. {{(pid=86703) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 15:49:51 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Copying metadata from image 24de6a15-160a-43ff-9850-07708cdb3a13 to 9b24f3fd-02dc-42ba-ab2c-fa31fa059830. {{(pid=86703) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 15:49:51 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Creating volume glance metadata for volume 9b24f3fd-02dc-42ba-ab2c-fa31fa059830 backed by image 24de6a15-160a-43ff-9850-07708cdb3a13 with: {'image_id': '24de6a15-160a-43ff-9850-07708cdb3a13', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '494af7ef5f832f65caf4a8ed4876d30a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86703) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 15:49:51 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (434bf618-9338-4bed-8155-d1d9b45a1679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b24f3fd-02dc-42ba-ab2c-fa31fa059830', 'volume_size': 1, 'image_id': '24de6a15-160a-43ff-9850-07708cdb3a13', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/24de6a15-160a-43ff-9850-07708cdb3a13', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '494af7ef5f832f65caf4a8ed4876d30a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'edbc1337ab684b08a9589eaa26cc97bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd2c43cd23f17b6ffb020479ba93cece0da4b470c4b4c7e76c4c6e709d038decf8590b427cad701833f7edd6c1e2c5e14c361b9a16a9f40b580dd3bff22bfb3e6', 'id': '24de6a15-160a-43ff-9850-07708cdb3a13', 'created_at': datetime.datetime(2026, 11, 2, 14, 49, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 14, 49, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/24de6a15-160a-43ff-9850-07708cdb3a13/file', 'properties': {}}, 'image_service': }' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:51 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb222896-4bff-4bb8-8d0b-9dba27ba53c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:51 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Volume volume-9b24f3fd-02dc-42ba-ab2c-fa31fa059830 (9b24f3fd-02dc-42ba-ab2c-fa31fa059830): created successfully Nov 02 15:49:51 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb222896-4bff-4bb8-8d0b-9dba27ba53c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:51 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Flow 'volume_create_manager' (d6f94220-8df0-4e71-8f62-b88e4cde0546) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:49:51 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-f9734d8c-ec1d-4aa7-beea-2d733c98677d tempest-VolumeImageDependencyTests-1920555118 None] Created volume successfully. Nov 02 15:49:52 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-eecefb5b-676c-4b44-a1c2-f4acb4369392 tempest-VolumeImageDependencyTests-1920555118 None] Acquiring lock "cinder-9b24f3fd-02dc-42ba-ab2c-fa31fa059830-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:49:52 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-eecefb5b-676c-4b44-a1c2-f4acb4369392 tempest-VolumeImageDependencyTests-1920555118 None] Lock "cinder-9b24f3fd-02dc-42ba-ab2c-fa31fa059830-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:49:52 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-eecefb5b-676c-4b44-a1c2-f4acb4369392 tempest-VolumeImageDependencyTests-1920555118 None] Acquiring lock "cinder-quobyte-9b24f3fd-02dc-42ba-ab2c-fa31fa059830" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:49:52 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-eecefb5b-676c-4b44-a1c2-f4acb4369392 tempest-VolumeImageDependencyTests-1920555118 None] Lock "cinder-quobyte-9b24f3fd-02dc-42ba-ab2c-fa31fa059830" acquired by "delete_volume" :: waited 0.017s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:49:52 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2a8be2-db65-4c8b-89f4-b852ed1811ad]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:49:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-eecefb5b-676c-4b44-a1c2-f4acb4369392 tempest-VolumeImageDependencyTests-1920555118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9b24f3fd-02dc-42ba-ab2c-fa31fa059830 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:53 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9b24f3fd-02dc-42ba-ab2c-fa31fa059830 Nov 02 15:49:53 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:53 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-eecefb5b-676c-4b44-a1c2-f4acb4369392 tempest-VolumeImageDependencyTests-1920555118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9b24f3fd-02dc-42ba-ab2c-fa31fa059830" returned: 0 in 0.347s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-eecefb5b-676c-4b44-a1c2-f4acb4369392 tempest-VolumeImageDependencyTests-1920555118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9b24f3fd-02dc-42ba-ab2c-fa31fa059830 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:53 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9b24f3fd-02dc-42ba-ab2c-fa31fa059830 Nov 02 15:49:53 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:53 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-eecefb5b-676c-4b44-a1c2-f4acb4369392 tempest-VolumeImageDependencyTests-1920555118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9b24f3fd-02dc-42ba-ab2c-fa31fa059830" returned: 0 in 0.238s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:53 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-eecefb5b-676c-4b44-a1c2-f4acb4369392 tempest-VolumeImageDependencyTests-1920555118 None] Lock "cinder-quobyte-9b24f3fd-02dc-42ba-ab2c-fa31fa059830" released by "delete_volume" :: held 0.622s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:49:53 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-eecefb5b-676c-4b44-a1c2-f4acb4369392 tempest-VolumeImageDependencyTests-1920555118 None] Created reservations ['9c029f7b-3e91-45c2-8def-2bb1ccdc21f7', '19650971-584f-4bad-996f-804426a2f769', '712eb3da-7362-4c39-b627-98b6782448a2', '39aeeab0-d9ab-41e4-af2d-40f668197132'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:49:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-eecefb5b-676c-4b44-a1c2-f4acb4369392 tempest-VolumeImageDependencyTests-1920555118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:49:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-eecefb5b-676c-4b44-a1c2-f4acb4369392 tempest-VolumeImageDependencyTests-1920555118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:49:53 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-eecefb5b-676c-4b44-a1c2-f4acb4369392 tempest-VolumeImageDependencyTests-1920555118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:49:53 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-eecefb5b-676c-4b44-a1c2-f4acb4369392 tempest-VolumeImageDependencyTests-1920555118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:49:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-eecefb5b-676c-4b44-a1c2-f4acb4369392 tempest-VolumeImageDependencyTests-1920555118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:49:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-eecefb5b-676c-4b44-a1c2-f4acb4369392 tempest-VolumeImageDependencyTests-1920555118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:53 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:49:53 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:53 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-eecefb5b-676c-4b44-a1c2-f4acb4369392 tempest-VolumeImageDependencyTests-1920555118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.236s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:53 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-eecefb5b-676c-4b44-a1c2-f4acb4369392 tempest-VolumeImageDependencyTests-1920555118 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:49:53 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-eecefb5b-676c-4b44-a1c2-f4acb4369392 tempest-VolumeImageDependencyTests-1920555118 None] Deleted volume successfully. Nov 02 15:49:53 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-eecefb5b-676c-4b44-a1c2-f4acb4369392 tempest-VolumeImageDependencyTests-1920555118 None] Lock "cinder-9b24f3fd-02dc-42ba-ab2c-fa31fa059830-delete_volume" released by "delete_volume" :: held 1.099s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:49:57 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:49:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] Flow 'volume_create_manager' (445a11bf-3c7d-4956-a4aa-7ba11d59ebd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:49:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (639d827a-8a8d-4fa1-8139-2a33eed6e488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (639d827a-8a8d-4fa1-8139-2a33eed6e488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1621355952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c19a6b08-96b8-4841-85a8-18c0d0d3c0d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5f7b7546454844a4e6f8b1ff0e6b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:49:57Z,use_quota=True,user_id='6abb00e7b8554acfa9b4d5ce59f1945d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee03f066-aef0-4602-b0b8-030239f2d68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee03f066-aef0-4602-b0b8-030239f2d68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd95bc71-d1de-4980-b226-a33ae2fa7365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd95bc71-d1de-4980-b226-a33ae2fa7365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c19a6b08-96b8-4841-85a8-18c0d0d3c0d4', 'volume_name': 'volume-c19a6b08-96b8-4841-85a8-18c0d0d3c0d4', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8fb182f-8470-478e-986b-c54f82720f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8fb182f-8470-478e-986b-c54f82720f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd8e339-742f-46c2-a328-e8462e5a132c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:57 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] Volume c19a6b08-96b8-4841-85a8-18c0d0d3c0d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c19a6b08-96b8-4841-85a8-18c0d0d3c0d4', 'volume_size': 1} Nov 02 15:49:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:49:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:49:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:49:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1621355952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c19a6b08-96b8-4841-85a8-18c0d0d3c0d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5f7b7546454844a4e6f8b1ff0e6b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:49:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:49:57Z,use_quota=True,user_id='6abb00e7b8554acfa9b4d5ce59f1945d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:49:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] Creating volume c19a6b08-96b8-4841-85a8-18c0d0d3c0d4 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:49:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:49:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:49:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:49:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:49:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:49:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:49:57 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:49:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c19a6b08-96b8-4841-85a8-18c0d0d3c0d4 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:57 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c19a6b08-96b8-4841-85a8-18c0d0d3c0d4 1073741824 Nov 02 15:49:57 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:57 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c19a6b08-96b8-4841-85a8-18c0d0d3c0d4 1073741824" returned: 0 in 0.395s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c19a6b08-96b8-4841-85a8-18c0d0d3c0d4 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:57 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c19a6b08-96b8-4841-85a8-18c0d0d3c0d4 Nov 02 15:49:57 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:58 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c19a6b08-96b8-4841-85a8-18c0d0d3c0d4" returned: 0 in 0.233s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:58 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] <== create_volume: return (665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:49:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.668s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:49:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cd8e339-742f-46c2-a328-e8462e5a132c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c19a6b08-96b8-4841-85a8-18c0d0d3c0d4', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fedfd7c-cba0-4c25-aea7-8922dd39d347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:49:58 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] Volume volume-c19a6b08-96b8-4841-85a8-18c0d0d3c0d4 (c19a6b08-96b8-4841-85a8-18c0d0d3c0d4): created successfully Nov 02 15:49:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fedfd7c-cba0-4c25-aea7-8922dd39d347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:49:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] Flow 'volume_create_manager' (445a11bf-3c7d-4956-a4aa-7ba11d59ebd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:49:58 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-f8cef12f-5e6a-4b46-9348-7bc20bed2055 tempest-ProjectReaderTests-708756646 None] Created volume successfully. Nov 02 15:49:58 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7b43a27e-cfd9-4e95-ad56-cf6c1c4e90d6 tempest-ProjectReaderTests-708756646 None] Acquiring lock "cinder-c19a6b08-96b8-4841-85a8-18c0d0d3c0d4-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:49:58 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7b43a27e-cfd9-4e95-ad56-cf6c1c4e90d6 tempest-ProjectReaderTests-708756646 None] Lock "cinder-c19a6b08-96b8-4841-85a8-18c0d0d3c0d4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:49:58 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7b43a27e-cfd9-4e95-ad56-cf6c1c4e90d6 tempest-ProjectReaderTests-708756646 None] Acquiring lock "cinder-quobyte-c19a6b08-96b8-4841-85a8-18c0d0d3c0d4" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:49:58 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7b43a27e-cfd9-4e95-ad56-cf6c1c4e90d6 tempest-ProjectReaderTests-708756646 None] Lock "cinder-quobyte-c19a6b08-96b8-4841-85a8-18c0d0d3c0d4" acquired by "delete_volume" :: waited 0.014s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:49:58 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b097858a-87f7-43b2-8076-768dd551bdac]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:49:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7b43a27e-cfd9-4e95-ad56-cf6c1c4e90d6 tempest-ProjectReaderTests-708756646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c19a6b08-96b8-4841-85a8-18c0d0d3c0d4 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:58 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c19a6b08-96b8-4841-85a8-18c0d0d3c0d4 Nov 02 15:49:58 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:59 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7b43a27e-cfd9-4e95-ad56-cf6c1c4e90d6 tempest-ProjectReaderTests-708756646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c19a6b08-96b8-4841-85a8-18c0d0d3c0d4" returned: 0 in 0.359s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7b43a27e-cfd9-4e95-ad56-cf6c1c4e90d6 tempest-ProjectReaderTests-708756646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c19a6b08-96b8-4841-85a8-18c0d0d3c0d4 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:59 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c19a6b08-96b8-4841-85a8-18c0d0d3c0d4 Nov 02 15:49:59 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:59 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7b43a27e-cfd9-4e95-ad56-cf6c1c4e90d6 tempest-ProjectReaderTests-708756646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c19a6b08-96b8-4841-85a8-18c0d0d3c0d4" returned: 0 in 0.225s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:59 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7b43a27e-cfd9-4e95-ad56-cf6c1c4e90d6 tempest-ProjectReaderTests-708756646 None] Lock "cinder-quobyte-c19a6b08-96b8-4841-85a8-18c0d0d3c0d4" released by "delete_volume" :: held 0.621s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:49:59 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-7b43a27e-cfd9-4e95-ad56-cf6c1c4e90d6 tempest-ProjectReaderTests-708756646 None] Created reservations ['b0191b68-8aa6-410d-98c8-17506e9fabbd', 'e36f4037-1a8f-4a7d-9b85-3962b7944173', 'f5068bfc-518d-4a25-a024-7554534c4336', '02fe107a-1053-445a-ae2d-8ba662278036'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:49:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7b43a27e-cfd9-4e95-ad56-cf6c1c4e90d6 tempest-ProjectReaderTests-708756646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:49:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7b43a27e-cfd9-4e95-ad56-cf6c1c4e90d6 tempest-ProjectReaderTests-708756646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:49:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7b43a27e-cfd9-4e95-ad56-cf6c1c4e90d6 tempest-ProjectReaderTests-708756646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:49:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7b43a27e-cfd9-4e95-ad56-cf6c1c4e90d6 tempest-ProjectReaderTests-708756646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:49:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7b43a27e-cfd9-4e95-ad56-cf6c1c4e90d6 tempest-ProjectReaderTests-708756646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:49:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7b43a27e-cfd9-4e95-ad56-cf6c1c4e90d6 tempest-ProjectReaderTests-708756646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:49:59 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:49:59 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:49:59 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Nov 02 15:49:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7b43a27e-cfd9-4e95-ad56-cf6c1c4e90d6 tempest-ProjectReaderTests-708756646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.231s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:49:59 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-7b43a27e-cfd9-4e95-ad56-cf6c1c4e90d6 tempest-ProjectReaderTests-708756646 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:49:59 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-7b43a27e-cfd9-4e95-ad56-cf6c1c4e90d6 tempest-ProjectReaderTests-708756646 None] Deleted volume successfully. Nov 02 15:49:59 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7b43a27e-cfd9-4e95-ad56-cf6c1c4e90d6 tempest-ProjectReaderTests-708756646 None] Lock "cinder-c19a6b08-96b8-4841-85a8-18c0d0d3c0d4-delete_volume" released by "delete_volume" :: held 1.049s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:00 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:50:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] Flow 'volume_create_manager' (50770994-1312-4d17-8811-f15a0205d625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f7e1416-37ec-4222-b2a1-203680ad9d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f7e1416-37ec-4222-b2a1-203680ad9d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-534298016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca71f1e2-8fe7-4b40-8268-7dd40d7c62bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5f7b7546454844a4e6f8b1ff0e6b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:00Z,use_quota=True,user_id='6abb00e7b8554acfa9b4d5ce59f1945d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5497ecd6-63eb-4eff-a035-4b1781f21a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5497ecd6-63eb-4eff-a035-4b1781f21a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b40ec2d-09a6-4857-8fc0-9a8c31f55f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b40ec2d-09a6-4857-8fc0-9a8c31f55f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca71f1e2-8fe7-4b40-8268-7dd40d7c62bf', 'volume_name': 'volume-ca71f1e2-8fe7-4b40-8268-7dd40d7c62bf', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fa6ba4f-f573-4542-b2ea-2c37590e19d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fa6ba4f-f573-4542-b2ea-2c37590e19d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f69a3a4d-21b7-4d00-a7af-7de79a31633b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:00 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] Volume ca71f1e2-8fe7-4b40-8268-7dd40d7c62bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca71f1e2-8fe7-4b40-8268-7dd40d7c62bf', 'volume_size': 1} Nov 02 15:50:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:00 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-534298016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca71f1e2-8fe7-4b40-8268-7dd40d7c62bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5f7b7546454844a4e6f8b1ff0e6b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:00Z,use_quota=True,user_id='6abb00e7b8554acfa9b4d5ce59f1945d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:50:00 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] Creating volume ca71f1e2-8fe7-4b40-8268-7dd40d7c62bf {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:50:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:00 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:00 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:00 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:50:00 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:50:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ca71f1e2-8fe7-4b40-8268-7dd40d7c62bf 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:00 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ca71f1e2-8fe7-4b40-8268-7dd40d7c62bf 1073741824 Nov 02 15:50:00 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:00 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ca71f1e2-8fe7-4b40-8268-7dd40d7c62bf 1073741824" returned: 0 in 0.399s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ca71f1e2-8fe7-4b40-8268-7dd40d7c62bf {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:00 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ca71f1e2-8fe7-4b40-8268-7dd40d7c62bf Nov 02 15:50:00 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:00 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ca71f1e2-8fe7-4b40-8268-7dd40d7c62bf" returned: 0 in 0.228s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:00 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:50:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.668s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f69a3a4d-21b7-4d00-a7af-7de79a31633b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca71f1e2-8fe7-4b40-8268-7dd40d7c62bf', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7f69001-e94c-45df-bb84-069d7819719d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:00 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] Volume volume-ca71f1e2-8fe7-4b40-8268-7dd40d7c62bf (ca71f1e2-8fe7-4b40-8268-7dd40d7c62bf): created successfully Nov 02 15:50:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7f69001-e94c-45df-bb84-069d7819719d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] Flow 'volume_create_manager' (50770994-1312-4d17-8811-f15a0205d625) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:00 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-aa16bb31-7e58-4993-93b3-1aea1bb9d722 tempest-ProjectReaderTests-708756646 None] Created volume successfully. Nov 02 15:50:01 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0db719a3-e73a-47d1-8dd9-b21a746f075d tempest-ProjectReaderTests-708756646 None] Acquiring lock "cinder-ca71f1e2-8fe7-4b40-8268-7dd40d7c62bf-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:01 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0db719a3-e73a-47d1-8dd9-b21a746f075d tempest-ProjectReaderTests-708756646 None] Lock "cinder-ca71f1e2-8fe7-4b40-8268-7dd40d7c62bf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:01 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0db719a3-e73a-47d1-8dd9-b21a746f075d tempest-ProjectReaderTests-708756646 None] Acquiring lock "cinder-quobyte-ca71f1e2-8fe7-4b40-8268-7dd40d7c62bf" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:01 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0db719a3-e73a-47d1-8dd9-b21a746f075d tempest-ProjectReaderTests-708756646 None] Lock "cinder-quobyte-ca71f1e2-8fe7-4b40-8268-7dd40d7c62bf" acquired by "delete_volume" :: waited 0.012s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:01 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[847581f8-99a8-47f3-b11e-bed0d98431fc]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0db719a3-e73a-47d1-8dd9-b21a746f075d tempest-ProjectReaderTests-708756646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ca71f1e2-8fe7-4b40-8268-7dd40d7c62bf {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:01 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ca71f1e2-8fe7-4b40-8268-7dd40d7c62bf Nov 02 15:50:01 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:01 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0db719a3-e73a-47d1-8dd9-b21a746f075d tempest-ProjectReaderTests-708756646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ca71f1e2-8fe7-4b40-8268-7dd40d7c62bf" returned: 0 in 0.332s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0db719a3-e73a-47d1-8dd9-b21a746f075d tempest-ProjectReaderTests-708756646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ca71f1e2-8fe7-4b40-8268-7dd40d7c62bf {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:01 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ca71f1e2-8fe7-4b40-8268-7dd40d7c62bf Nov 02 15:50:01 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:01 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0db719a3-e73a-47d1-8dd9-b21a746f075d tempest-ProjectReaderTests-708756646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ca71f1e2-8fe7-4b40-8268-7dd40d7c62bf" returned: 0 in 0.231s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:01 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0db719a3-e73a-47d1-8dd9-b21a746f075d tempest-ProjectReaderTests-708756646 None] Lock "cinder-quobyte-ca71f1e2-8fe7-4b40-8268-7dd40d7c62bf" released by "delete_volume" :: held 0.600s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:01 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-0db719a3-e73a-47d1-8dd9-b21a746f075d tempest-ProjectReaderTests-708756646 None] Created reservations ['333bf670-fbe7-42ea-bee5-dcbb1fa95d3c', 'e7ab1d68-5c42-4d2f-bbdf-15a6601f7426', '064c8c6b-3f3f-44c2-941f-9f49ea0eb834', '7213aaac-fc42-4e45-ba7b-4d1d176147b6'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:50:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0db719a3-e73a-47d1-8dd9-b21a746f075d tempest-ProjectReaderTests-708756646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0db719a3-e73a-47d1-8dd9-b21a746f075d tempest-ProjectReaderTests-708756646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:01 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-0db719a3-e73a-47d1-8dd9-b21a746f075d tempest-ProjectReaderTests-708756646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:01 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-0db719a3-e73a-47d1-8dd9-b21a746f075d tempest-ProjectReaderTests-708756646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0db719a3-e73a-47d1-8dd9-b21a746f075d tempest-ProjectReaderTests-708756646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0db719a3-e73a-47d1-8dd9-b21a746f075d tempest-ProjectReaderTests-708756646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:01 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:50:01 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:02 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0db719a3-e73a-47d1-8dd9-b21a746f075d tempest-ProjectReaderTests-708756646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.225s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:02 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-0db719a3-e73a-47d1-8dd9-b21a746f075d tempest-ProjectReaderTests-708756646 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:50:02 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-0db719a3-e73a-47d1-8dd9-b21a746f075d tempest-ProjectReaderTests-708756646 None] Deleted volume successfully. Nov 02 15:50:02 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0db719a3-e73a-47d1-8dd9-b21a746f075d tempest-ProjectReaderTests-708756646 None] Lock "cinder-ca71f1e2-8fe7-4b40-8268-7dd40d7c62bf-delete_volume" released by "delete_volume" :: held 1.000s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:02 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:50:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] Flow 'volume_create_manager' (5ad843a1-8a24-475f-876e-9eba6fc45a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18b15c97-84d4-4806-a834-4cb2bbaadecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18b15c97-84d4-4806-a834-4cb2bbaadecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1785358666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3271752f-f6d0-49f3-a9f5-89fdc7dd4197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5f7b7546454844a4e6f8b1ff0e6b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:03Z,use_quota=True,user_id='6abb00e7b8554acfa9b4d5ce59f1945d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b54cc8-6857-4ed3-814e-869bdf9f6a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b54cc8-6857-4ed3-814e-869bdf9f6a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2a73115-01a5-4c35-8563-28e519fab780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2a73115-01a5-4c35-8563-28e519fab780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3271752f-f6d0-49f3-a9f5-89fdc7dd4197', 'volume_name': 'volume-3271752f-f6d0-49f3-a9f5-89fdc7dd4197', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e81666-2ba6-44c0-8581-d30b816be454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e81666-2ba6-44c0-8581-d30b816be454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc1e27fe-a165-424e-bcb6-e52159a4fd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:02 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] Volume 3271752f-f6d0-49f3-a9f5-89fdc7dd4197: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3271752f-f6d0-49f3-a9f5-89fdc7dd4197', 'volume_size': 1} Nov 02 15:50:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1785358666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3271752f-f6d0-49f3-a9f5-89fdc7dd4197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5f7b7546454844a4e6f8b1ff0e6b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:03Z,use_quota=True,user_id='6abb00e7b8554acfa9b4d5ce59f1945d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:50:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] Creating volume 3271752f-f6d0-49f3-a9f5-89fdc7dd4197 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:50:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:50:02 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:50:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3271752f-f6d0-49f3-a9f5-89fdc7dd4197 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:02 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3271752f-f6d0-49f3-a9f5-89fdc7dd4197 1073741824 Nov 02 15:50:02 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:03 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3271752f-f6d0-49f3-a9f5-89fdc7dd4197 1073741824" returned: 0 in 0.390s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3271752f-f6d0-49f3-a9f5-89fdc7dd4197 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:03 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3271752f-f6d0-49f3-a9f5-89fdc7dd4197 Nov 02 15:50:03 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:03 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3271752f-f6d0-49f3-a9f5-89fdc7dd4197" returned: 0 in 0.245s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:03 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:50:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:03 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc1e27fe-a165-424e-bcb6-e52159a4fd23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3271752f-f6d0-49f3-a9f5-89fdc7dd4197', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:03 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca75ef4a-6420-4d10-8a65-b0e5a531ed7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:03 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] Volume volume-3271752f-f6d0-49f3-a9f5-89fdc7dd4197 (3271752f-f6d0-49f3-a9f5-89fdc7dd4197): created successfully Nov 02 15:50:03 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca75ef4a-6420-4d10-8a65-b0e5a531ed7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:03 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] Flow 'volume_create_manager' (5ad843a1-8a24-475f-876e-9eba6fc45a41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:03 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-235b075c-0aad-4b5e-9828-9e37faba298e tempest-ProjectReaderTests-708756646 None] Created volume successfully. Nov 02 15:50:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d0d24096-972e-4330-8f2c-4a1d610809b8 tempest-ProjectReaderTests-708756646 None] Acquiring lock "cinder-3271752f-f6d0-49f3-a9f5-89fdc7dd4197-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d0d24096-972e-4330-8f2c-4a1d610809b8 tempest-ProjectReaderTests-708756646 None] Lock "cinder-3271752f-f6d0-49f3-a9f5-89fdc7dd4197-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d0d24096-972e-4330-8f2c-4a1d610809b8 tempest-ProjectReaderTests-708756646 None] Acquiring lock "cinder-quobyte-3271752f-f6d0-49f3-a9f5-89fdc7dd4197" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d0d24096-972e-4330-8f2c-4a1d610809b8 tempest-ProjectReaderTests-708756646 None] Lock "cinder-quobyte-3271752f-f6d0-49f3-a9f5-89fdc7dd4197" acquired by "delete_volume" :: waited 0.014s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:03 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83b639f-88bd-4625-8d71-1dc798c2a2cc]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d0d24096-972e-4330-8f2c-4a1d610809b8 tempest-ProjectReaderTests-708756646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3271752f-f6d0-49f3-a9f5-89fdc7dd4197 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:04 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3271752f-f6d0-49f3-a9f5-89fdc7dd4197 Nov 02 15:50:04 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:04 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d0d24096-972e-4330-8f2c-4a1d610809b8 tempest-ProjectReaderTests-708756646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3271752f-f6d0-49f3-a9f5-89fdc7dd4197" returned: 0 in 0.359s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d0d24096-972e-4330-8f2c-4a1d610809b8 tempest-ProjectReaderTests-708756646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3271752f-f6d0-49f3-a9f5-89fdc7dd4197 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:04 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3271752f-f6d0-49f3-a9f5-89fdc7dd4197 Nov 02 15:50:04 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:04 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d0d24096-972e-4330-8f2c-4a1d610809b8 tempest-ProjectReaderTests-708756646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3271752f-f6d0-49f3-a9f5-89fdc7dd4197" returned: 0 in 0.246s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:04 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d0d24096-972e-4330-8f2c-4a1d610809b8 tempest-ProjectReaderTests-708756646 None] Lock "cinder-quobyte-3271752f-f6d0-49f3-a9f5-89fdc7dd4197" released by "delete_volume" :: held 0.644s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:04 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-d0d24096-972e-4330-8f2c-4a1d610809b8 tempest-ProjectReaderTests-708756646 None] Created reservations ['61691538-3bb6-4ff1-bf7a-bc17403db816', 'c5158a36-9ea1-4189-aa7c-2ae47d75c94a', 'c9eaac46-8da9-4561-9520-a2c9f448ce0a', '9d3d1acc-a0b8-4359-8664-773f0f8b6533'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:50:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d0d24096-972e-4330-8f2c-4a1d610809b8 tempest-ProjectReaderTests-708756646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d0d24096-972e-4330-8f2c-4a1d610809b8 tempest-ProjectReaderTests-708756646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:04 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d0d24096-972e-4330-8f2c-4a1d610809b8 tempest-ProjectReaderTests-708756646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:04 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d0d24096-972e-4330-8f2c-4a1d610809b8 tempest-ProjectReaderTests-708756646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d0d24096-972e-4330-8f2c-4a1d610809b8 tempest-ProjectReaderTests-708756646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d0d24096-972e-4330-8f2c-4a1d610809b8 tempest-ProjectReaderTests-708756646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:04 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:50:04 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:04 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d0d24096-972e-4330-8f2c-4a1d610809b8 tempest-ProjectReaderTests-708756646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.268s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:04 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-d0d24096-972e-4330-8f2c-4a1d610809b8 tempest-ProjectReaderTests-708756646 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:50:04 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-d0d24096-972e-4330-8f2c-4a1d610809b8 tempest-ProjectReaderTests-708756646 None] Deleted volume successfully. Nov 02 15:50:05 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d0d24096-972e-4330-8f2c-4a1d610809b8 tempest-ProjectReaderTests-708756646 None] Lock "cinder-3271752f-f6d0-49f3-a9f5-89fdc7dd4197-delete_volume" released by "delete_volume" :: held 1.163s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:05 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:50:05 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] Flow 'volume_create_manager' (5097dcf6-1460-4062-913c-b33cf9ca789a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:05 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a17bb4b5-b18d-4868-90a8-5688e84fc74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:05 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a17bb4b5-b18d-4868-90a8-5688e84fc74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-402370378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f4010a-f756-47a1-800a-d470f37980c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5f7b7546454844a4e6f8b1ff0e6b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:05Z,use_quota=True,user_id='6abb00e7b8554acfa9b4d5ce59f1945d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:05 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (499b4ac8-94fe-4a73-81f4-d15eb405787d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:05 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (499b4ac8-94fe-4a73-81f4-d15eb405787d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:05 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ca30dfa-4bce-492f-994a-25775a1caa1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:05 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ca30dfa-4bce-492f-994a-25775a1caa1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0f4010a-f756-47a1-800a-d470f37980c8', 'volume_name': 'volume-c0f4010a-f756-47a1-800a-d470f37980c8', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:05 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae788d7-f983-43bc-aac1-3bc9777daf7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:05 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae788d7-f983-43bc-aac1-3bc9777daf7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:05 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e54382d-10e8-46b7-ad6f-27680f563535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:05 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] Volume c0f4010a-f756-47a1-800a-d470f37980c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0f4010a-f756-47a1-800a-d470f37980c8', 'volume_size': 1} Nov 02 15:50:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:05 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-402370378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f4010a-f756-47a1-800a-d470f37980c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d5f7b7546454844a4e6f8b1ff0e6b63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:05Z,use_quota=True,user_id='6abb00e7b8554acfa9b4d5ce59f1945d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:50:05 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] Creating volume c0f4010a-f756-47a1-800a-d470f37980c8 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:50:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:05 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:05 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:05 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:50:05 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:50:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c0f4010a-f756-47a1-800a-d470f37980c8 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:05 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c0f4010a-f756-47a1-800a-d470f37980c8 1073741824 Nov 02 15:50:05 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:05 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c0f4010a-f756-47a1-800a-d470f37980c8 1073741824" returned: 0 in 0.427s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c0f4010a-f756-47a1-800a-d470f37980c8 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:05 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c0f4010a-f756-47a1-800a-d470f37980c8 Nov 02 15:50:05 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:06 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c0f4010a-f756-47a1-800a-d470f37980c8" returned: 0 in 0.229s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:06 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:50:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:06 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e54382d-10e8-46b7-ad6f-27680f563535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0f4010a-f756-47a1-800a-d470f37980c8', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:06 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e43cb2f-f0fb-484a-ad17-491445ba2796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:06 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] Volume volume-c0f4010a-f756-47a1-800a-d470f37980c8 (c0f4010a-f756-47a1-800a-d470f37980c8): created successfully Nov 02 15:50:06 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e43cb2f-f0fb-484a-ad17-491445ba2796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:06 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] Flow 'volume_create_manager' (5097dcf6-1460-4062-913c-b33cf9ca789a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:06 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-18cac2c3-ab4a-46a0-ad20-7486fe9454bf tempest-ProjectReaderTests-708756646 None] Created volume successfully. Nov 02 15:50:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b6319a7a-bf26-49a8-b422-e385d02f0318 tempest-ProjectReaderTests-708756646 None] Acquiring lock "cinder-c0f4010a-f756-47a1-800a-d470f37980c8-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b6319a7a-bf26-49a8-b422-e385d02f0318 tempest-ProjectReaderTests-708756646 None] Lock "cinder-c0f4010a-f756-47a1-800a-d470f37980c8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b6319a7a-bf26-49a8-b422-e385d02f0318 tempest-ProjectReaderTests-708756646 None] Acquiring lock "cinder-quobyte-c0f4010a-f756-47a1-800a-d470f37980c8" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b6319a7a-bf26-49a8-b422-e385d02f0318 tempest-ProjectReaderTests-708756646 None] Lock "cinder-quobyte-c0f4010a-f756-47a1-800a-d470f37980c8" acquired by "delete_volume" :: waited 0.016s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:06 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fdf549-dfb7-4b4b-9b7e-56f6c3c4d03e]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b6319a7a-bf26-49a8-b422-e385d02f0318 tempest-ProjectReaderTests-708756646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c0f4010a-f756-47a1-800a-d470f37980c8 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:06 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c0f4010a-f756-47a1-800a-d470f37980c8 Nov 02 15:50:06 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:06 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b6319a7a-bf26-49a8-b422-e385d02f0318 tempest-ProjectReaderTests-708756646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c0f4010a-f756-47a1-800a-d470f37980c8" returned: 0 in 0.352s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b6319a7a-bf26-49a8-b422-e385d02f0318 tempest-ProjectReaderTests-708756646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c0f4010a-f756-47a1-800a-d470f37980c8 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:06 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c0f4010a-f756-47a1-800a-d470f37980c8 Nov 02 15:50:06 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:07 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b6319a7a-bf26-49a8-b422-e385d02f0318 tempest-ProjectReaderTests-708756646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c0f4010a-f756-47a1-800a-d470f37980c8" returned: 0 in 0.251s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:07 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b6319a7a-bf26-49a8-b422-e385d02f0318 tempest-ProjectReaderTests-708756646 None] Lock "cinder-quobyte-c0f4010a-f756-47a1-800a-d470f37980c8" released by "delete_volume" :: held 0.651s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:07 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-b6319a7a-bf26-49a8-b422-e385d02f0318 tempest-ProjectReaderTests-708756646 None] Created reservations ['4ae22e55-8335-4c74-856c-e887946cd781', '15dc9e92-fa76-4125-8c58-82c3ce92812b', '9dbc96ba-020a-4abe-986b-067d910ff929', '41be9828-61e9-4bce-829c-14f449ece4cc'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:50:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b6319a7a-bf26-49a8-b422-e385d02f0318 tempest-ProjectReaderTests-708756646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b6319a7a-bf26-49a8-b422-e385d02f0318 tempest-ProjectReaderTests-708756646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:07 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b6319a7a-bf26-49a8-b422-e385d02f0318 tempest-ProjectReaderTests-708756646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:07 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b6319a7a-bf26-49a8-b422-e385d02f0318 tempest-ProjectReaderTests-708756646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b6319a7a-bf26-49a8-b422-e385d02f0318 tempest-ProjectReaderTests-708756646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b6319a7a-bf26-49a8-b422-e385d02f0318 tempest-ProjectReaderTests-708756646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:07 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:50:07 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:07 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b6319a7a-bf26-49a8-b422-e385d02f0318 tempest-ProjectReaderTests-708756646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.264s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:07 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-b6319a7a-bf26-49a8-b422-e385d02f0318 tempest-ProjectReaderTests-708756646 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:50:07 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-b6319a7a-bf26-49a8-b422-e385d02f0318 tempest-ProjectReaderTests-708756646 None] Deleted volume successfully. Nov 02 15:50:07 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b6319a7a-bf26-49a8-b422-e385d02f0318 tempest-ProjectReaderTests-708756646 None] Lock "cinder-c0f4010a-f756-47a1-800a-d470f37980c8-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:17 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:UPDATE=135,cinder:SELECT=97,cinder:INSERT=48,cinder:DELETE=18 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:50:17 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=113,cinder:UPDATE=150,cinder:INSERT=36,cinder:DELETE=7 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] Flow 'volume_create_manager' (6c0a7731-40c2-48a9-829c-3118ed26e601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b011bba-9b63-4149-bd9c-2f0f526a60b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] Flow 'volume_create_manager' (24f3ac46-0a60-4b2b-b1bc-b481811d6202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cc350f1-0a4d-4f24-9aa5-14fd966b46bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b011bba-9b63-4149-bd9c-2f0f526a60b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1885500111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0006cebd-3e52-46fb-a72a-04cef236b39c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c7c2100523643bb8e44818d36967715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:20Z,use_quota=True,user_id='3ba6007d63d641828a6c6e8c44bd6bdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd83e65b-2566-4bf1-8ac7-7f9486259664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd83e65b-2566-4bf1-8ac7-7f9486259664) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b213b7f2-b186-4243-9de0-a36f6b2ce2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b213b7f2-b186-4243-9de0-a36f6b2ce2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0006cebd-3e52-46fb-a72a-04cef236b39c', 'volume_name': 'volume-0006cebd-3e52-46fb-a72a-04cef236b39c', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb8550a2-4829-47e8-b509-fa741bf3ef00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb8550a2-4829-47e8-b509-fa741bf3ef00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c874d687-a10f-495b-a312-9c5a6357ead3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:20 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] Volume 0006cebd-3e52-46fb-a72a-04cef236b39c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0006cebd-3e52-46fb-a72a-04cef236b39c', 'volume_size': 1} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1885500111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0006cebd-3e52-46fb-a72a-04cef236b39c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c7c2100523643bb8e44818d36967715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:20Z,use_quota=True,user_id='3ba6007d63d641828a6c6e8c44bd6bdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] Creating volume 0006cebd-3e52-46fb-a72a-04cef236b39c {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:50:20 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cc350f1-0a4d-4f24-9aa5-14fd966b46bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1208030677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e328351-18e8-4b8f-8408-407edd005c64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8ee14db31a46b6b60b25b273983923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:20Z,use_quota=True,user_id='7d8cd918cb5e465f86525ed50a572279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcbb1a38-8739-42c8-bb47-4ff1ec2e1fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcbb1a38-8739-42c8-bb47-4ff1ec2e1fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6461ea35-7ebe-47fe-b55f-f7fd58b29d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:20 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c 1073741824 Nov 02 15:50:20 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6461ea35-7ebe-47fe-b55f-f7fd58b29d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e328351-18e8-4b8f-8408-407edd005c64', 'volume_name': 'volume-5e328351-18e8-4b8f-8408-407edd005c64', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b8157b-fb35-4cf6-a5bd-8df5af7b1453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b8157b-fb35-4cf6-a5bd-8df5af7b1453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d0848ca-5424-4331-a011-7fe5ba67aefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:20 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] Volume 5e328351-18e8-4b8f-8408-407edd005c64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e328351-18e8-4b8f-8408-407edd005c64', 'volume_size': 1} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] Flow 'volume_create_manager' (804569ef-1b47-405c-b8d7-10b9accec39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b395bd54-4471-486e-9ec8-313afdecce9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b395bd54-4471-486e-9ec8-313afdecce9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1193722325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c2cb208-c44e-4195-b2f3-a515f5cce8d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8ee14db31a46b6b60b25b273983923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:20Z,use_quota=True,user_id='7d8cd918cb5e465f86525ed50a572279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e87bf9a-80e6-4467-b1ab-21f71d6f2ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e87bf9a-80e6-4467-b1ab-21f71d6f2ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03fa6118-3c8f-419b-84dc-f39cc0c5953b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03fa6118-3c8f-419b-84dc-f39cc0c5953b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c2cb208-c44e-4195-b2f3-a515f5cce8d7', 'volume_name': 'volume-5c2cb208-c44e-4195-b2f3-a515f5cce8d7', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bef19338-23ef-4ceb-9ec3-a0099f00bbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bef19338-23ef-4ceb-9ec3-a0099f00bbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02763b1f-c858-4561-b3a1-cb62f261b33a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:20 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] Volume 5c2cb208-c44e-4195-b2f3-a515f5cce8d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c2cb208-c44e-4195-b2f3-a515f5cce8d7', 'volume_size': 1} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:20 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:50:20 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] Flow 'volume_create_manager' (57954b05-34a7-4adc-96c2-409fca268f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4876dc15-c4ae-4119-98f0-2dadacbd17d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:21 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:21 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4876dc15-c4ae-4119-98f0-2dadacbd17d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-117760605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d90382d-95b2-4227-a1f2-749c062fdc7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8ee14db31a46b6b60b25b273983923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:21Z,use_quota=True,user_id='7d8cd918cb5e465f86525ed50a572279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ad274b-f14e-4bb1-a01f-5257165dfc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ad274b-f14e-4bb1-a01f-5257165dfc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15884454-0a89-42c8-840e-79a003b960c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15884454-0a89-42c8-840e-79a003b960c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d90382d-95b2-4227-a1f2-749c062fdc7c', 'volume_name': 'volume-8d90382d-95b2-4227-a1f2-749c062fdc7c', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ce1ae7-12c5-4659-b4f9-4d6043ac09ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ce1ae7-12c5-4659-b4f9-4d6043ac09ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ecdad7-e6b1-43f1-aa6b-975464b7da6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:21 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] Volume 8d90382d-95b2-4227-a1f2-749c062fdc7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d90382d-95b2-4227-a1f2-749c062fdc7c', 'volume_size': 1} Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.638s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c 1073741824" returned: 0 in 0.932s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager._thread_info {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread count: 29 {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread info: [<_MainThread(MainThread, started 125876361756800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:21 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c Nov 02 15:50:21 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:21 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c" returned: 0 in 0.354s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.389s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.328s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1208030677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e328351-18e8-4b8f-8408-407edd005c64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8ee14db31a46b6b60b25b273983923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:20Z,use_quota=True,user_id='7d8cd918cb5e465f86525ed50a572279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] Creating volume 5e328351-18e8-4b8f-8408-407edd005c64 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:50:21 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e328351-18e8-4b8f-8408-407edd005c64 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:21 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e328351-18e8-4b8f-8408-407edd005c64 1073741824 Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c874d687-a10f-495b-a312-9c5a6357ead3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0006cebd-3e52-46fb-a72a-04cef236b39c', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:21 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20dd3738-e62a-4abb-9798-30281e838e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:21 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] Volume volume-0006cebd-3e52-46fb-a72a-04cef236b39c (0006cebd-3e52-46fb-a72a-04cef236b39c): created successfully Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20dd3738-e62a-4abb-9798-30281e838e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] Flow 'volume_create_manager' (6c0a7731-40c2-48a9-829c-3118ed26e601) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:50:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] Flow 'volume_create_manager' (5f96ab1b-7de0-471b-8795-e2b1f0edf4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed8755f-d172-4fe8-a17f-e5d20f25c676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ed8755f-d172-4fe8-a17f-e5d20f25c676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-270963394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a038b3f-1d16-4c33-93b9-c666ae3e5251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081ecbd5e3694d9d9779db39943c12e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:22Z,use_quota=True,user_id='c8c5dd94e82a45439e6816d23423ecdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3553d87-e6f9-4383-bf46-3ff2cc486991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3553d87-e6f9-4383-bf46-3ff2cc486991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37cffc07-4995-4eab-b6ca-5f7067bcf9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37cffc07-4995-4eab-b6ca-5f7067bcf9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a038b3f-1d16-4c33-93b9-c666ae3e5251', 'volume_name': 'volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b2293a-9c4f-4614-bb9b-4790285e9563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8b2293a-9c4f-4614-bb9b-4790285e9563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cac10ce2-ea5a-4626-90e9-92dc5f8ed5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:22 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] Volume 8a038b3f-1d16-4c33-93b9-c666ae3e5251: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251', 'volume_size': 1} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:22 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-1b19d485-4b4b-49a8-816e-92ba5c31f399 tempest-CreateVolumesFromSnapshotTest-337369598 None] Created volume successfully. Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] Flow 'volume_create_manager' (47dbcf27-c678-4721-b220-0828f249c4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612cfc27-d3ac-4a6f-beca-27d7db480775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612cfc27-d3ac-4a6f-beca-27d7db480775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-809422650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0153931a-c88c-4518-8b9d-475e4d3a4a2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8ee14db31a46b6b60b25b273983923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:22Z,use_quota=True,user_id='7d8cd918cb5e465f86525ed50a572279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c62078e-4082-4857-8e70-b9ec175e63f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c62078e-4082-4857-8e70-b9ec175e63f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e90adf-bf46-4dda-9d54-9fb7f101d9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6e90adf-bf46-4dda-9d54-9fb7f101d9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0153931a-c88c-4518-8b9d-475e4d3a4a2e', 'volume_name': 'volume-0153931a-c88c-4518-8b9d-475e4d3a4a2e', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (122125e8-1aa8-4305-a8cf-3e35a6474e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (122125e8-1aa8-4305-a8cf-3e35a6474e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c556f8f6-7314-4e59-b2db-6a7075e8e19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:22 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] Volume 0153931a-c88c-4518-8b9d-475e4d3a4a2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0153931a-c88c-4518-8b9d-475e4d3a4a2e', 'volume_size': 1} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] Flow 'volume_create_manager' (eecfa510-666a-4604-b272-1389ac1cbb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65293aa3-af03-4f67-9250-f46dced5768f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65293aa3-af03-4f67-9250-f46dced5768f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1055268467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c442e4-221f-40cf-bb11-e00fa93a228d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8ee14db31a46b6b60b25b273983923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:22Z,use_quota=True,user_id='7d8cd918cb5e465f86525ed50a572279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27a16b5f-c611-4c6f-b4e9-d2e2bff74a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27a16b5f-c611-4c6f-b4e9-d2e2bff74a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3990f0d5-afd9-4659-b2af-9fa0559a3269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3990f0d5-afd9-4659-b2af-9fa0559a3269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24c442e4-221f-40cf-bb11-e00fa93a228d', 'volume_name': 'volume-24c442e4-221f-40cf-bb11-e00fa93a228d', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b8b7396-6f6e-4336-bb92-e4c7ce52b06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b8b7396-6f6e-4336-bb92-e4c7ce52b06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56cb1e7-ce47-4275-86db-62826e251d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:22 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] Volume 24c442e4-221f-40cf-bb11-e00fa93a228d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24c442e4-221f-40cf-bb11-e00fa93a228d', 'volume_size': 1} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:22 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e328351-18e8-4b8f-8408-407edd005c64 1073741824" returned: 0 in 0.766s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e328351-18e8-4b8f-8408-407edd005c64 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:22 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e328351-18e8-4b8f-8408-407edd005c64 Nov 02 15:50:22 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-213a3886-33e3-42a4-994d-170359db0f7d tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:23 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e328351-18e8-4b8f-8408-407edd005c64" returned: 0 in 0.245s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:23 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:50:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.575s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:23 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1193722325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c2cb208-c44e-4195-b2f3-a515f5cce8d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8ee14db31a46b6b60b25b273983923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:20Z,use_quota=True,user_id='7d8cd918cb5e465f86525ed50a572279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:50:23 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] Creating volume 5c2cb208-c44e-4195-b2f3-a515f5cce8d7 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:50:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:23 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:23 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:23 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:50:23 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:50:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5c2cb208-c44e-4195-b2f3-a515f5cce8d7 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d0848ca-5424-4331-a011-7fe5ba67aefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e328351-18e8-4b8f-8408-407edd005c64', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:23 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5c2cb208-c44e-4195-b2f3-a515f5cce8d7 1073741824 Nov 02 15:50:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6d570e5-0e69-4170-8a15-cf20c3d1daaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:23 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:23 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] Volume volume-5e328351-18e8-4b8f-8408-407edd005c64 (5e328351-18e8-4b8f-8408-407edd005c64): created successfully Nov 02 15:50:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6d570e5-0e69-4170-8a15-cf20c3d1daaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] Flow 'volume_create_manager' (24f3ac46-0a60-4b2b-b1bc-b481811d6202) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:23 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-75fbbc3d-45ac-4f97-a154-066927503ace tempest-CreateVolumesFromImageTest-920449825 None] Created volume successfully. Nov 02 15:50:23 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5c2cb208-c44e-4195-b2f3-a515f5cce8d7 1073741824" returned: 0 in 0.472s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5c2cb208-c44e-4195-b2f3-a515f5cce8d7 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:23 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5c2cb208-c44e-4195-b2f3-a515f5cce8d7 Nov 02 15:50:23 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:23 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5c2cb208-c44e-4195-b2f3-a515f5cce8d7" returned: 0 in 0.258s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:23 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:50:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.686s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-117760605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d90382d-95b2-4227-a1f2-749c062fdc7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8ee14db31a46b6b60b25b273983923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:21Z,use_quota=True,user_id='7d8cd918cb5e465f86525ed50a572279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] Creating volume 8d90382d-95b2-4227-a1f2-749c062fdc7c {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:50:24 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8d90382d-95b2-4227-a1f2-749c062fdc7c 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02763b1f-c858-4561-b3a1-cb62f261b33a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c2cb208-c44e-4195-b2f3-a515f5cce8d7', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd35f772-00a1-4932-b8c2-2b280e5b75e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:24 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8d90382d-95b2-4227-a1f2-749c062fdc7c 1073741824 Nov 02 15:50:24 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:24 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] Volume volume-5c2cb208-c44e-4195-b2f3-a515f5cce8d7 (5c2cb208-c44e-4195-b2f3-a515f5cce8d7): created successfully Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd35f772-00a1-4932-b8c2-2b280e5b75e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] Flow 'volume_create_manager' (804569ef-1b47-405c-b8d7-10b9accec39b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:24 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-4c793cff-fb92-4e78-942f-9415a24765bc tempest-CreateVolumesFromImageTest-920449825 None] Created volume successfully. Nov 02 15:50:24 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8d90382d-95b2-4227-a1f2-749c062fdc7c 1073741824" returned: 0 in 0.520s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8d90382d-95b2-4227-a1f2-749c062fdc7c {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:24 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8d90382d-95b2-4227-a1f2-749c062fdc7c Nov 02 15:50:24 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Flow 'volume_create_manager' (ce650c1e-c4e9-4541-b0b0-11ff1291b181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb583cad-8572-4262-ad87-202b8aebd050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb583cad-8572-4262-ad87-202b8aebd050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=816589b6-7018-463a-8c8a-4521416913de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2665d6c9058c489d89efc4a64fd4e904',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:25Z,use_quota=True,user_id='f2ccab74187c4b4b92664b2712282bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fde66d7-c075-4241-b466-55a2888fc73c),volume_type_id=9fde66d7-c075-4241-b466-55a2888fc73c)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abce904-12ff-4fd7-8e66-bd13dc144338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4abce904-12ff-4fd7-8e66-bd13dc144338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06010f36-e214-4d22-94f2-e3a3bec7d784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG cinder.image.glance [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Creating Keystone auth plugin from conf {{(pid=86703) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 15:50:24 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8d90382d-95b2-4227-a1f2-749c062fdc7c" returned: 0 in 0.294s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.808s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-270963394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a038b3f-1d16-4c33-93b9-c666ae3e5251,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081ecbd5e3694d9d9779db39943c12e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:22Z,use_quota=True,user_id='c8c5dd94e82a45439e6816d23423ecdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] Creating volume 8a038b3f-1d16-4c33-93b9-c666ae3e5251 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:50:24 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85ecdad7-e6b1-43f1-aa6b-975464b7da6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d90382d-95b2-4227-a1f2-749c062fdc7c', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25bae394-8aab-471a-bb2f-476868355c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:24 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251 1073741824 Nov 02 15:50:24 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:24 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] Volume volume-8d90382d-95b2-4227-a1f2-749c062fdc7c (8d90382d-95b2-4227-a1f2-749c062fdc7c): created successfully Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25bae394-8aab-471a-bb2f-476868355c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] Flow 'volume_create_manager' (57954b05-34a7-4adc-96c2-409fca268f22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:24 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-241f5a5f-4921-4c81-ad21-014261f30112 tempest-CreateVolumesFromImageTest-920449825 None] Created volume successfully. Nov 02 15:50:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06010f36-e214-4d22-94f2-e3a3bec7d784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '816589b6-7018-463a-8c8a-4521416913de', 'volume_name': 'volume-816589b6-7018-463a-8c8a-4521416913de', 'volume_size': 1, 'image_id': '239bcbb3-ccda-45dd-91ae-3b1327590f14', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/239bcbb3-ccda-45dd-91ae-3b1327590f14', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5827c17d920c2cc63afa32bc7e8e082a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2665d6c9058c489d89efc4a64fd4e904', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3e7ec6b24a8a2229ddd00badb22518a79c39df0b2c265006de6e71dc051abe4f2971c69d5be79700215f3b507a84a54d2a4ce1d94f1dc139c10318875f45fd82', 'id': '239bcbb3-ccda-45dd-91ae-3b1327590f14', 'created_at': datetime.datetime(2026, 11, 2, 14, 50, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 14, 50, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/239bcbb3-ccda-45dd-91ae-3b1327590f14/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9f13a47-501d-43af-ad46-a063d3d29d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9f13a47-501d-43af-ad46-a063d3d29d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (187e62fd-8201-4536-a6bb-5d4698a38a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:25 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Volume 816589b6-7018-463a-8c8a-4521416913de: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-816589b6-7018-463a-8c8a-4521416913de', 'volume_size': 1, 'image_id': '239bcbb3-ccda-45dd-91ae-3b1327590f14', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/239bcbb3-ccda-45dd-91ae-3b1327590f14', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5827c17d920c2cc63afa32bc7e8e082a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2665d6c9058c489d89efc4a64fd4e904', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3e7ec6b24a8a2229ddd00badb22518a79c39df0b2c265006de6e71dc051abe4f2971c69d5be79700215f3b507a84a54d2a4ce1d94f1dc139c10318875f45fd82', 'id': '239bcbb3-ccda-45dd-91ae-3b1327590f14', 'created_at': datetime.datetime(2026, 11, 2, 14, 50, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 14, 50, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/239bcbb3-ccda-45dd-91ae-3b1327590f14/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 02 15:50:25 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Trying to clone 816589b6-7018-463a-8c8a-4521416913de from image 239bcbb3-ccda-45dd-91ae-3b1327590f14 at location (None, [{'url': 'file:///opt/stack/data/glance/images/239bcbb3-ccda-45dd-91ae-3b1327590f14', 'metadata': {}}]). {{(pid=86703) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 15:50:25 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_239bcbb3-ccda-45dd-91ae-3b1327590f14_o65vfp6xdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86703) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 15:50:25 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Image download 0.00 MB at 0.00 MB/s Nov 02 15:50:25 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf38cd9-1beb-42e7-89cd-942d8ef1ac7a]: (4, 'raw') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_239bcbb3-ccda-45dd-91ae-3b1327590f14_o65vfp6xdevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:25 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251 1073741824" returned: 0 in 0.448s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:25 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_239bcbb3-ccda-45dd-91ae-3b1327590f14_o65vfp6xdevstack@QuobyteHD Nov 02 15:50:25 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:25 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251 Nov 02 15:50:25 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:25 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_239bcbb3-ccda-45dd-91ae-3b1327590f14_o65vfp6xdevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_239bcbb3-ccda-45dd-91ae-3b1327590f14_o65vfp6xdevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:25 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251" returned: 0 in 0.253s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:50:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.437s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-809422650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0153931a-c88c-4518-8b9d-475e4d3a4a2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8ee14db31a46b6b60b25b273983923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:22Z,use_quota=True,user_id='7d8cd918cb5e465f86525ed50a572279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:50:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] Creating volume 0153931a-c88c-4518-8b9d-475e4d3a4a2e {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:50:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:50:25 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:50:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0153931a-c88c-4518-8b9d-475e4d3a4a2e 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cac10ce2-ea5a-4626-90e9-92dc5f8ed5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:25 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0153931a-c88c-4518-8b9d-475e4d3a4a2e 1073741824 Nov 02 15:50:25 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e104b78-dabe-43f1-987e-ad78b3da4298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:25 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] Volume volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251 (8a038b3f-1d16-4c33-93b9-c666ae3e5251): created successfully Nov 02 15:50:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e104b78-dabe-43f1-987e-ad78b3da4298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] Flow 'volume_create_manager' (5f96ab1b-7de0-471b-8795-e2b1f0edf4ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:25 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_239bcbb3-ccda-45dd-91ae-3b1327590f14_o65vfp6xdevstack@QuobyteHD Nov 02 15:50:25 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:25 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-de3114e0-e798-4f46-bc3c-413c27495182 tempest-ProjectReaderTests-665207650 None] Created volume successfully. Nov 02 15:50:25 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_239bcbb3-ccda-45dd-91ae-3b1327590f14_o65vfp6xdevstack@QuobyteHD" returned: 1 in 0.332s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_239bcbb3-ccda-45dd-91ae-3b1327590f14_o65vfp6xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 15:50:25 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Temporary image 239bcbb3-ccda-45dd-91ae-3b1327590f14 is fetched for user f2ccab74187c4b4b92664b2712282bde. {{(pid=86703) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 15:50:26 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0ca4a1-4f43-485f-bba7-343bf92c3c5b]: (4, 'raw') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_239bcbb3-ccda-45dd-91ae-3b1327590f14_o65vfp6xdevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:26 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_239bcbb3-ccda-45dd-91ae-3b1327590f14_o65vfp6xdevstack@QuobyteHD Nov 02 15:50:26 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:26 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0153931a-c88c-4518-8b9d-475e4d3a4a2e 1073741824" returned: 0 in 0.506s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0153931a-c88c-4518-8b9d-475e4d3a4a2e {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:26 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0153931a-c88c-4518-8b9d-475e4d3a4a2e Nov 02 15:50:26 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:26 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_239bcbb3-ccda-45dd-91ae-3b1327590f14_o65vfp6xdevstack@QuobyteHD" returned: 0 in 0.316s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_239bcbb3-ccda-45dd-91ae-3b1327590f14_o65vfp6xdevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:26 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0153931a-c88c-4518-8b9d-475e4d3a4a2e" returned: 0 in 0.238s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:50:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.949s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1055268467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24c442e4-221f-40cf-bb11-e00fa93a228d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8ee14db31a46b6b60b25b273983923',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:22Z,use_quota=True,user_id='7d8cd918cb5e465f86525ed50a572279',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:50:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] Creating volume 24c442e4-221f-40cf-bb11-e00fa93a228d {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:50:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:50:26 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:50:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24c442e4-221f-40cf-bb11-e00fa93a228d 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:26 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_239bcbb3-ccda-45dd-91ae-3b1327590f14_o65vfp6xdevstack@QuobyteHD Nov 02 15:50:26 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c556f8f6-7314-4e59-b2db-6a7075e8e19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0153931a-c88c-4518-8b9d-475e4d3a4a2e', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:26 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24c442e4-221f-40cf-bb11-e00fa93a228d 1073741824 Nov 02 15:50:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4107ed4e-1ea6-4828-aede-4a3b8d6b33c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:26 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:26 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] Volume volume-0153931a-c88c-4518-8b9d-475e4d3a4a2e (0153931a-c88c-4518-8b9d-475e4d3a4a2e): created successfully Nov 02 15:50:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4107ed4e-1ea6-4828-aede-4a3b8d6b33c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] Flow 'volume_create_manager' (47dbcf27-c678-4721-b220-0828f249c4aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:26 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-d8d32ef8-7452-4447-b600-b6f874bf7927 tempest-CreateVolumesFromImageTest-920449825 None] Created volume successfully. Nov 02 15:50:26 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_239bcbb3-ccda-45dd-91ae-3b1327590f14_o65vfp6xdevstack@QuobyteHD" returned: 1 in 0.337s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_239bcbb3-ccda-45dd-91ae-3b1327590f14_o65vfp6xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 15:50:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:26 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24c442e4-221f-40cf-bb11-e00fa93a228d 1073741824" returned: 0 in 0.466s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24c442e4-221f-40cf-bb11-e00fa93a228d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:26 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24c442e4-221f-40cf-bb11-e00fa93a228d Nov 02 15:50:26 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c6653693-b4cf-4b59-857b-212f1d01f2e6 tempest-ProjectReaderTests-665207650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:27 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24c442e4-221f-40cf-bb11-e00fa93a228d" returned: 0 in 0.263s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:27 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:50:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-213a3886-33e3-42a4-994d-170359db0f7d tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.182s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56cb1e7-ce47-4275-86db-62826e251d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24c442e4-221f-40cf-bb11-e00fa93a228d', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d6e44f3-7400-4ac4-bdc4-6b94b0740167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:27 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-213a3886-33e3-42a4-994d-170359db0f7d tempest-CreateVolumesFromSnapshotTest-337369598 None] Creating offline snapshot d1179415-ca8b-4d3b-9ce4-b4cbbb266709 of volume 0006cebd-3e52-46fb-a72a-04cef236b39c {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:50:27 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] Volume volume-24c442e4-221f-40cf-bb11-e00fa93a228d (24c442e4-221f-40cf-bb11-e00fa93a228d): created successfully Nov 02 15:50:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d6e44f3-7400-4ac4-bdc4-6b94b0740167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] Flow 'volume_create_manager' (eecfa510-666a-4604-b272-1389ac1cbb63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:27 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec13ee7-1293-4170-8062-4156d244fdd9]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-213a3886-33e3-42a4-994d-170359db0f7d tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:27 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-93639d6f-c800-4cad-80a8-1a569b90d55a tempest-CreateVolumesFromImageTest-920449825 None] Created volume successfully. Nov 02 15:50:27 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c Nov 02 15:50:27 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:27 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-213a3886-33e3-42a4-994d-170359db0f7d tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c" returned: 0 in 0.342s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-213a3886-33e3-42a4-994d-170359db0f7d tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c.d1179415-ca8b-4d3b-9ce4-b4cbbb266709 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:27 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c.d1179415-ca8b-4d3b-9ce4-b4cbbb266709 1G Nov 02 15:50:27 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-acf0e698-0a26-4a8a-b702-3bb99ef16a7f tempest-CreateVolumesFromImageTest-920449825 None] Acquiring lock "cinder-24c442e4-221f-40cf-bb11-e00fa93a228d-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-acf0e698-0a26-4a8a-b702-3bb99ef16a7f tempest-CreateVolumesFromImageTest-920449825 None] Lock "cinder-24c442e4-221f-40cf-bb11-e00fa93a228d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-acf0e698-0a26-4a8a-b702-3bb99ef16a7f tempest-CreateVolumesFromImageTest-920449825 None] Acquiring lock "cinder-quobyte-24c442e4-221f-40cf-bb11-e00fa93a228d" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-acf0e698-0a26-4a8a-b702-3bb99ef16a7f tempest-CreateVolumesFromImageTest-920449825 None] Lock "cinder-quobyte-24c442e4-221f-40cf-bb11-e00fa93a228d" acquired by "delete_volume" :: waited 0.013s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:27 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bdb1812-31b8-4ae8-9be1-a246659c5ba2]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-acf0e698-0a26-4a8a-b702-3bb99ef16a7f tempest-CreateVolumesFromImageTest-920449825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24c442e4-221f-40cf-bb11-e00fa93a228d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:28 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-213a3886-33e3-42a4-994d-170359db0f7d tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c.d1179415-ca8b-4d3b-9ce4-b4cbbb266709 1G" returned: 0 in 0.472s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-213a3886-33e3-42a4-994d-170359db0f7d tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0006cebd-3e52-46fb-a72a-04cef236b39c -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c.d1179415-ca8b-4d3b-9ce4-b4cbbb266709 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:28 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0006cebd-3e52-46fb-a72a-04cef236b39c -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c.d1179415-ca8b-4d3b-9ce4-b4cbbb266709 Nov 02 15:50:28 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:28 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24c442e4-221f-40cf-bb11-e00fa93a228d Nov 02 15:50:28 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:28 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-acf0e698-0a26-4a8a-b702-3bb99ef16a7f tempest-CreateVolumesFromImageTest-920449825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24c442e4-221f-40cf-bb11-e00fa93a228d" returned: 0 in 0.356s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-acf0e698-0a26-4a8a-b702-3bb99ef16a7f tempest-CreateVolumesFromImageTest-920449825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24c442e4-221f-40cf-bb11-e00fa93a228d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:28 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-213a3886-33e3-42a4-994d-170359db0f7d tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0006cebd-3e52-46fb-a72a-04cef236b39c -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c.d1179415-ca8b-4d3b-9ce4-b4cbbb266709" returned: 0 in 0.292s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:28 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-213a3886-33e3-42a4-994d-170359db0f7d tempest-CreateVolumesFromSnapshotTest-337369598 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c.d1179415-ca8b-4d3b-9ce4-b4cbbb266709 is being set with open permissions: ugo+rw Nov 02 15:50:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-213a3886-33e3-42a4-994d-170359db0f7d tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c.d1179415-ca8b-4d3b-9ce4-b4cbbb266709 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:28 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24c442e4-221f-40cf-bb11-e00fa93a228d Nov 02 15:50:28 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:28 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c.d1179415-ca8b-4d3b-9ce4-b4cbbb266709 Nov 02 15:50:28 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:28 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-acf0e698-0a26-4a8a-b702-3bb99ef16a7f tempest-CreateVolumesFromImageTest-920449825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-24c442e4-221f-40cf-bb11-e00fa93a228d" returned: 0 in 0.236s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:28 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-213a3886-33e3-42a4-994d-170359db0f7d tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c.d1179415-ca8b-4d3b-9ce4-b4cbbb266709" returned: 0 in 0.236s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:28 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-acf0e698-0a26-4a8a-b702-3bb99ef16a7f tempest-CreateVolumesFromImageTest-920449825 None] Lock "cinder-quobyte-24c442e4-221f-40cf-bb11-e00fa93a228d" released by "delete_volume" :: held 0.637s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-213a3886-33e3-42a4-994d-170359db0f7d tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:28 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c.info Nov 02 15:50:28 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:28 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-acf0e698-0a26-4a8a-b702-3bb99ef16a7f tempest-CreateVolumesFromImageTest-920449825 None] Created reservations ['b15e779e-32f2-45bc-91ec-5b400dbebb81', '271282e3-c1f7-497d-9823-c3a04e8273c1', '9e51db1b-3b2c-4c8c-8345-b2a0a0af08ef', '51329893-fd65-4d8b-953b-ca72c8e59c67'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:50:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-acf0e698-0a26-4a8a-b702-3bb99ef16a7f tempest-CreateVolumesFromImageTest-920449825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-acf0e698-0a26-4a8a-b702-3bb99ef16a7f tempest-CreateVolumesFromImageTest-920449825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-acf0e698-0a26-4a8a-b702-3bb99ef16a7f tempest-CreateVolumesFromImageTest-920449825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:28 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-acf0e698-0a26-4a8a-b702-3bb99ef16a7f tempest-CreateVolumesFromImageTest-920449825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-acf0e698-0a26-4a8a-b702-3bb99ef16a7f tempest-CreateVolumesFromImageTest-920449825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-acf0e698-0a26-4a8a-b702-3bb99ef16a7f tempest-CreateVolumesFromImageTest-920449825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:28 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:50:28 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:28 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-213a3886-33e3-42a4-994d-170359db0f7d tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c.info" returned: 0 in 0.246s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:28 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-213a3886-33e3-42a4-994d-170359db0f7d tempest-CreateVolumesFromSnapshotTest-337369598 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c.info is being set with open permissions: ugo+rw Nov 02 15:50:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-213a3886-33e3-42a4-994d-170359db0f7d tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:28 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c.info Nov 02 15:50:28 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:28 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-acf0e698-0a26-4a8a-b702-3bb99ef16a7f tempest-CreateVolumesFromImageTest-920449825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.252s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:28 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-acf0e698-0a26-4a8a-b702-3bb99ef16a7f tempest-CreateVolumesFromImageTest-920449825 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:50:29 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-acf0e698-0a26-4a8a-b702-3bb99ef16a7f tempest-CreateVolumesFromImageTest-920449825 None] Deleted volume successfully. Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-acf0e698-0a26-4a8a-b702-3bb99ef16a7f tempest-CreateVolumesFromImageTest-920449825 None] Lock "cinder-24c442e4-221f-40cf-bb11-e00fa93a228d-delete_volume" released by "delete_volume" :: held 1.121s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6c7d8cec-7150-4343-82db-2509a92cc5bf tempest-CreateVolumesFromImageTest-920449825 None] Acquiring lock "cinder-0153931a-c88c-4518-8b9d-475e4d3a4a2e-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6c7d8cec-7150-4343-82db-2509a92cc5bf tempest-CreateVolumesFromImageTest-920449825 None] Lock "cinder-0153931a-c88c-4518-8b9d-475e4d3a4a2e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6c7d8cec-7150-4343-82db-2509a92cc5bf tempest-CreateVolumesFromImageTest-920449825 None] Acquiring lock "cinder-quobyte-0153931a-c88c-4518-8b9d-475e4d3a4a2e" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6c7d8cec-7150-4343-82db-2509a92cc5bf tempest-CreateVolumesFromImageTest-920449825 None] Lock "cinder-quobyte-0153931a-c88c-4518-8b9d-475e4d3a4a2e" acquired by "delete_volume" :: waited 0.019s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:29 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-213a3886-33e3-42a4-994d-170359db0f7d tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c.info" returned: 0 in 0.289s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-213a3886-33e3-42a4-994d-170359db0f7d tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.996s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5132bd6e-ba0b-44cf-bb79-a10481a50c0f]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.526s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=816589b6-7018-463a-8c8a-4521416913de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2665d6c9058c489d89efc4a64fd4e904',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:25Z,use_quota=True,user_id='f2ccab74187c4b4b92664b2712282bde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fde66d7-c075-4241-b466-55a2888fc73c),volume_type_id=9fde66d7-c075-4241-b466-55a2888fc73c)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Creating volume 816589b6-7018-463a-8c8a-4521416913de {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:50:29 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-816589b6-7018-463a-8c8a-4521416913de 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6c7d8cec-7150-4343-82db-2509a92cc5bf tempest-CreateVolumesFromImageTest-920449825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0153931a-c88c-4518-8b9d-475e4d3a4a2e {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:29 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-816589b6-7018-463a-8c8a-4521416913de 1073741824 Nov 02 15:50:29 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:29 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-213a3886-33e3-42a4-994d-170359db0f7d tempest-CreateVolumesFromSnapshotTest-337369598 None] Create snapshot completed successfully Nov 02 15:50:29 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0153931a-c88c-4518-8b9d-475e4d3a4a2e Nov 02 15:50:29 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:29 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6c7d8cec-7150-4343-82db-2509a92cc5bf tempest-CreateVolumesFromImageTest-920449825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0153931a-c88c-4518-8b9d-475e4d3a4a2e" returned: 0 in 0.349s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6c7d8cec-7150-4343-82db-2509a92cc5bf tempest-CreateVolumesFromImageTest-920449825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0153931a-c88c-4518-8b9d-475e4d3a4a2e {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:29 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0153931a-c88c-4518-8b9d-475e4d3a4a2e Nov 02 15:50:29 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:29 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-816589b6-7018-463a-8c8a-4521416913de 1073741824" returned: 0 in 0.421s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-816589b6-7018-463a-8c8a-4521416913de {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:29 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-816589b6-7018-463a-8c8a-4521416913de Nov 02 15:50:29 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:29 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6c7d8cec-7150-4343-82db-2509a92cc5bf tempest-CreateVolumesFromImageTest-920449825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0153931a-c88c-4518-8b9d-475e4d3a4a2e" returned: 0 in 0.238s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6c7d8cec-7150-4343-82db-2509a92cc5bf tempest-CreateVolumesFromImageTest-920449825 None] Lock "cinder-quobyte-0153931a-c88c-4518-8b9d-475e4d3a4a2e" released by "delete_volume" :: held 0.676s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-6c7d8cec-7150-4343-82db-2509a92cc5bf tempest-CreateVolumesFromImageTest-920449825 None] Created reservations ['0db3a7b7-0c63-4d3f-9761-cbf2d2c09943', '6dd261dd-3a51-41ba-8f0f-278825a6daba', '154f4916-3e82-45d2-992c-8f6e2a980025', 'dd16db8e-8546-4121-a931-4702e711d436'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:50:29 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-816589b6-7018-463a-8c8a-4521416913de" returned: 0 in 0.262s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c6653693-b4cf-4b59-857b-212f1d01f2e6 tempest-ProjectReaderTests-665207650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.891s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-c6653693-b4cf-4b59-857b-212f1d01f2e6 tempest-ProjectReaderTests-665207650 None] Creating offline snapshot 191cb20a-64b5-45e7-8214-0382d32c9869 of volume 8a038b3f-1d16-4c33-93b9-c666ae3e5251 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-6c7d8cec-7150-4343-82db-2509a92cc5bf tempest-CreateVolumesFromImageTest-920449825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-6c7d8cec-7150-4343-82db-2509a92cc5bf tempest-CreateVolumesFromImageTest-920449825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-6c7d8cec-7150-4343-82db-2509a92cc5bf tempest-CreateVolumesFromImageTest-920449825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-6c7d8cec-7150-4343-82db-2509a92cc5bf tempest-CreateVolumesFromImageTest-920449825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-6c7d8cec-7150-4343-82db-2509a92cc5bf tempest-CreateVolumesFromImageTest-920449825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6c7d8cec-7150-4343-82db-2509a92cc5bf tempest-CreateVolumesFromImageTest-920449825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd5d06c-6211-4142-a79a-6fb110e16d2f]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG cinder.volume.volume_utils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Attempting download of 239bcbb3-ccda-45dd-91ae-3b1327590f14 ((None, [{'url': 'file:///opt/stack/data/glance/images/239bcbb3-ccda-45dd-91ae-3b1327590f14', 'metadata': {}}])) to volume 816589b6-7018-463a-8c8a-4521416913de. {{(pid=86703) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 15:50:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c6653693-b4cf-4b59-857b-212f1d01f2e6 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:29 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:50:29 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:30 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9824db-6b69-4959-9db5-38ccf8c1c31f]: (4, 'raw') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_239bcbb3-ccda-45dd-91ae-3b1327590f14_fyr4bwae {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:30 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251 Nov 02 15:50:30 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:30 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_239bcbb3-ccda-45dd-91ae-3b1327590f14_fyr4bwae Nov 02 15:50:30 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:30 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-225b666f-9eca-47da-82c8-30ff0df785b9 tempest-CreateVolumesFromImageTest-920449825 None] Acquiring lock "cinder-8d90382d-95b2-4227-a1f2-749c062fdc7c-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:30 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:30 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-225b666f-9eca-47da-82c8-30ff0df785b9 tempest-CreateVolumesFromImageTest-920449825 None] Lock "cinder-8d90382d-95b2-4227-a1f2-749c062fdc7c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6c7d8cec-7150-4343-82db-2509a92cc5bf tempest-CreateVolumesFromImageTest-920449825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.352s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:30 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-6c7d8cec-7150-4343-82db-2509a92cc5bf tempest-CreateVolumesFromImageTest-920449825 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:50:30 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-6c7d8cec-7150-4343-82db-2509a92cc5bf tempest-CreateVolumesFromImageTest-920449825 None] Deleted volume successfully. Nov 02 15:50:30 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6c7d8cec-7150-4343-82db-2509a92cc5bf tempest-CreateVolumesFromImageTest-920449825 None] Lock "cinder-0153931a-c88c-4518-8b9d-475e4d3a4a2e-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:30 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-225b666f-9eca-47da-82c8-30ff0df785b9 tempest-CreateVolumesFromImageTest-920449825 None] Acquiring lock "cinder-quobyte-8d90382d-95b2-4227-a1f2-749c062fdc7c" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:30 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-225b666f-9eca-47da-82c8-30ff0df785b9 tempest-CreateVolumesFromImageTest-920449825 None] Lock "cinder-quobyte-8d90382d-95b2-4227-a1f2-749c062fdc7c" acquired by "delete_volume" :: waited 0.015s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:30 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c6653693-b4cf-4b59-857b-212f1d01f2e6 tempest-ProjectReaderTests-665207650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251" returned: 0 in 0.442s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c6653693-b4cf-4b59-857b-212f1d01f2e6 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251.191cb20a-64b5-45e7-8214-0382d32c9869 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:30 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9a0390-9a63-4cfd-9059-e53a57c8e66d]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-225b666f-9eca-47da-82c8-30ff0df785b9 tempest-CreateVolumesFromImageTest-920449825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8d90382d-95b2-4227-a1f2-749c062fdc7c {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:30 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_239bcbb3-ccda-45dd-91ae-3b1327590f14_fyr4bwae" returned: 0 in 0.408s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_239bcbb3-ccda-45dd-91ae-3b1327590f14_fyr4bwae {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:30 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251.191cb20a-64b5-45e7-8214-0382d32c9869 1G Nov 02 15:50:30 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:30 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8d90382d-95b2-4227-a1f2-749c062fdc7c Nov 02 15:50:30 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:30 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_239bcbb3-ccda-45dd-91ae-3b1327590f14_fyr4bwae Nov 02 15:50:30 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:30 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_239bcbb3-ccda-45dd-91ae-3b1327590f14_fyr4bwae" returned: 1 in 0.436s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_239bcbb3-ccda-45dd-91ae-3b1327590f14_fyr4bwae' failed. Not Retrying. {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 15:50:30 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[55b74920-4055-4961-bca4-45ed77c2eb40]: (4, 'raw') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_239bcbb3-ccda-45dd-91ae-3b1327590f14_o65vfp6xdevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:30 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-225b666f-9eca-47da-82c8-30ff0df785b9 tempest-CreateVolumesFromImageTest-920449825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8d90382d-95b2-4227-a1f2-749c062fdc7c" returned: 0 in 0.482s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-225b666f-9eca-47da-82c8-30ff0df785b9 tempest-CreateVolumesFromImageTest-920449825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8d90382d-95b2-4227-a1f2-749c062fdc7c {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:30 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:30 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:50:30 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8d90382d-95b2-4227-a1f2-749c062fdc7c Nov 02 15:50:30 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] Flow 'volume_create_manager' (613470c3-3b08-4877-a2ac-0968de26c366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:30 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (331dc0c2-5018-4d15-8958-716b5899da06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c6653693-b4cf-4b59-857b-212f1d01f2e6 tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251.191cb20a-64b5-45e7-8214-0382d32c9869 1G" returned: 0 in 0.562s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c6653693-b4cf-4b59-857b-212f1d01f2e6 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251.191cb20a-64b5-45e7-8214-0382d32c9869 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:31 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251.191cb20a-64b5-45e7-8214-0382d32c9869 Nov 02 15:50:31 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (331dc0c2-5018-4d15-8958-716b5899da06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1154429236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f61aa4ac-d4dd-47ae-baad-62f7501baa6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c7c2100523643bb8e44818d36967715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:31Z,use_quota=True,user_id='3ba6007d63d641828a6c6e8c44bd6bdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f904ec8f-c881-4f11-87e6-1cbf00625865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f904ec8f-c881-4f11-87e6-1cbf00625865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f51390f3-bcb2-4b68-a4d4-b12c65b797b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f51390f3-bcb2-4b68-a4d4-b12c65b797b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f61aa4ac-d4dd-47ae-baad-62f7501baa6f', 'volume_name': 'volume-f61aa4ac-d4dd-47ae-baad-62f7501baa6f', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5217841c-37de-46c4-bd9f-58bb9aa8465e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5217841c-37de-46c4-bd9f-58bb9aa8465e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:31 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_239bcbb3-ccda-45dd-91ae-3b1327590f14_o65vfp6xdevstack@QuobyteHD Nov 02 15:50:31 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ad2b2ef-d2af-4402-b9c2-9ee25300277e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:31 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] Volume f61aa4ac-d4dd-47ae-baad-62f7501baa6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f61aa4ac-d4dd-47ae-baad-62f7501baa6f', 'volume_size': 1} Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:31 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-225b666f-9eca-47da-82c8-30ff0df785b9 tempest-CreateVolumesFromImageTest-920449825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8d90382d-95b2-4227-a1f2-749c062fdc7c" returned: 0 in 0.366s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-225b666f-9eca-47da-82c8-30ff0df785b9 tempest-CreateVolumesFromImageTest-920449825 None] Lock "cinder-quobyte-8d90382d-95b2-4227-a1f2-749c062fdc7c" released by "delete_volume" :: held 0.918s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:31 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c6653693-b4cf-4b59-857b-212f1d01f2e6 tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251.191cb20a-64b5-45e7-8214-0382d32c9869" returned: 0 in 0.394s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:31 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-c6653693-b4cf-4b59-857b-212f1d01f2e6 tempest-ProjectReaderTests-665207650 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251.191cb20a-64b5-45e7-8214-0382d32c9869 is being set with open permissions: ugo+rw Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c6653693-b4cf-4b59-857b-212f1d01f2e6 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251.191cb20a-64b5-45e7-8214-0382d32c9869 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:31 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_239bcbb3-ccda-45dd-91ae-3b1327590f14_o65vfp6xdevstack@QuobyteHD" returned: 0 in 0.527s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_239bcbb3-ccda-45dd-91ae-3b1327590f14_o65vfp6xdevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:31 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251.191cb20a-64b5-45e7-8214-0382d32c9869 Nov 02 15:50:31 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-225b666f-9eca-47da-82c8-30ff0df785b9 tempest-CreateVolumesFromImageTest-920449825 None] Created reservations ['dec63f89-6710-4123-abff-7140c9f7edbe', '0b4361e0-fe9a-4ece-a3d0-d6856f175873', '1f64be54-91b0-49cd-80df-576157e30ee5', '92ea21af-347c-45a5-a4d7-ba40c1b99d13'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Flow 'volume_create_manager' (fabf89bc-bc10-499f-8cab-4e94d0c34541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aed5fef-8202-4503-89bb-95a15fb01257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:31 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_239bcbb3-ccda-45dd-91ae-3b1327590f14_o65vfp6xdevstack@QuobyteHD Nov 02 15:50:31 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aed5fef-8202-4503-89bb-95a15fb01257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-669116990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3767bd6a-0ff7-4583-9392-3a6e5bf912fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c7c2100523643bb8e44818d36967715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:31Z,use_quota=True,user_id='3ba6007d63d641828a6c6e8c44bd6bdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51aa6f2a-86b4-49b0-b73a-556395f2f755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51aa6f2a-86b4-49b0-b73a-556395f2f755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958aa761-4f33-44c9-9e4d-fd9f23cf125c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (958aa761-4f33-44c9-9e4d-fd9f23cf125c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3767bd6a-0ff7-4583-9392-3a6e5bf912fb', 'volume_name': 'volume-3767bd6a-0ff7-4583-9392-3a6e5bf912fb', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ad5fef-2232-4d2e-8366-58921fee2d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ad5fef-2232-4d2e-8366-58921fee2d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (988a973a-a9ee-4bc7-90f9-9e9e9438dd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:31 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Volume 3767bd6a-0ff7-4583-9392-3a6e5bf912fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3767bd6a-0ff7-4583-9392-3a6e5bf912fb', 'volume_size': 1} Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-225b666f-9eca-47da-82c8-30ff0df785b9 tempest-CreateVolumesFromImageTest-920449825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-225b666f-9eca-47da-82c8-30ff0df785b9 tempest-CreateVolumesFromImageTest-920449825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-225b666f-9eca-47da-82c8-30ff0df785b9 tempest-CreateVolumesFromImageTest-920449825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-225b666f-9eca-47da-82c8-30ff0df785b9 tempest-CreateVolumesFromImageTest-920449825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-225b666f-9eca-47da-82c8-30ff0df785b9 tempest-CreateVolumesFromImageTest-920449825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-225b666f-9eca-47da-82c8-30ff0df785b9 tempest-CreateVolumesFromImageTest-920449825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:31 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:50:31 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:31 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c6653693-b4cf-4b59-857b-212f1d01f2e6 tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251.191cb20a-64b5-45e7-8214-0382d32c9869" returned: 0 in 0.324s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c6653693-b4cf-4b59-857b-212f1d01f2e6 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:31 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_239bcbb3-ccda-45dd-91ae-3b1327590f14_o65vfp6xdevstack@QuobyteHD" returned: 1 in 0.366s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_239bcbb3-ccda-45dd-91ae-3b1327590f14_o65vfp6xdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] 239bcbb3-ccda-45dd-91ae-3b1327590f14 was raw, converting to qcow2 {{(pid=86703) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 15:50:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_239bcbb3-ccda-45dd-91ae-3b1327590f14_o65vfp6xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-816589b6-7018-463a-8c8a-4521416913de {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:31 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251.info Nov 02 15:50:31 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:31 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_239bcbb3-ccda-45dd-91ae-3b1327590f14_o65vfp6xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-816589b6-7018-463a-8c8a-4521416913de Nov 02 15:50:31 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:32 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:32 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-225b666f-9eca-47da-82c8-30ff0df785b9 tempest-CreateVolumesFromImageTest-920449825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.440s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-225b666f-9eca-47da-82c8-30ff0df785b9 tempest-CreateVolumesFromImageTest-920449825 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c6653693-b4cf-4b59-857b-212f1d01f2e6 tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251.info" returned: 0 in 0.327s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:32 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-c6653693-b4cf-4b59-857b-212f1d01f2e6 tempest-ProjectReaderTests-665207650 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251.info is being set with open permissions: ugo+rw Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c6653693-b4cf-4b59-857b-212f1d01f2e6 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:32 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-225b666f-9eca-47da-82c8-30ff0df785b9 tempest-CreateVolumesFromImageTest-920449825 None] Deleted volume successfully. Nov 02 15:50:32 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251.info Nov 02 15:50:32 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] Flow 'volume_create_manager' (de871f40-00f5-43d6-9e4a-6124ce497fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4f453db-decc-4ede-adc3-2614fa439008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-225b666f-9eca-47da-82c8-30ff0df785b9 tempest-CreateVolumesFromImageTest-920449825 None] Lock "cinder-8d90382d-95b2-4227-a1f2-749c062fdc7c-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4f453db-decc-4ede-adc3-2614fa439008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-454955961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd0178b3-6ba1-4cea-afce-431a3e219b84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c7c2100523643bb8e44818d36967715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:32Z,use_quota=True,user_id='3ba6007d63d641828a6c6e8c44bd6bdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdb9c072-335f-47fd-bcad-be290174e968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdb9c072-335f-47fd-bcad-be290174e968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a78104d0-bd9d-400a-b87c-8f27811d1fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a78104d0-bd9d-400a-b87c-8f27811d1fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd0178b3-6ba1-4cea-afce-431a3e219b84', 'volume_name': 'volume-fd0178b3-6ba1-4cea-afce-431a3e219b84', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f94fca3-b8e7-45de-85f7-fb1b9e7f8d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f94fca3-b8e7-45de-85f7-fb1b9e7f8d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c807284-89a2-461f-8a12-b2c316b68791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:32 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] Volume fd0178b3-6ba1-4cea-afce-431a3e219b84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd0178b3-6ba1-4cea-afce-431a3e219b84', 'volume_size': 1} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:32 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_239bcbb3-ccda-45dd-91ae-3b1327590f14_o65vfp6xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-816589b6-7018-463a-8c8a-4521416913de" returned: 0 in 0.606s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_239bcbb3-ccda-45dd-91ae-3b1327590f14_o65vfp6xdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-816589b6-7018-463a-8c8a-4521416913de {{(pid=86703) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 15:50:32 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-816589b6-7018-463a-8c8a-4521416913de 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:32 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-816589b6-7018-463a-8c8a-4521416913de 1G Nov 02 15:50:32 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:32 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c6653693-b4cf-4b59-857b-212f1d01f2e6 tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251.info" returned: 0 in 0.387s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c6653693-b4cf-4b59-857b-212f1d01f2e6 tempest-ProjectReaderTests-665207650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.596s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.443s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1154429236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f61aa4ac-d4dd-47ae-baad-62f7501baa6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c7c2100523643bb8e44818d36967715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:31Z,use_quota=True,user_id='3ba6007d63d641828a6c6e8c44bd6bdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] Creating volume f61aa4ac-d4dd-47ae-baad-62f7501baa6f {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:50:32 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f61aa4ac-d4dd-47ae-baad-62f7501baa6f 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6017d183-7cc5-4ca1-8be1-67e778b2303d tempest-CreateVolumesFromImageTest-920449825 None] Acquiring lock "cinder-5c2cb208-c44e-4195-b2f3-a515f5cce8d7-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:32 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f61aa4ac-d4dd-47ae-baad-62f7501baa6f 1073741824 Nov 02 15:50:32 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] Flow 'volume_create_manager' (7422fa3c-8cf7-4292-8ce8-2a612c84fd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98e3a5cc-d137-4654-bced-f89774822833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6017d183-7cc5-4ca1-8be1-67e778b2303d tempest-CreateVolumesFromImageTest-920449825 None] Lock "cinder-5c2cb208-c44e-4195-b2f3-a515f5cce8d7-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:32 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-c6653693-b4cf-4b59-857b-212f1d01f2e6 tempest-ProjectReaderTests-665207650 None] Create snapshot completed successfully Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98e3a5cc-d137-4654-bced-f89774822833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1313548549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81f5b373-02ca-435c-bb1c-e8af6454b484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c7c2100523643bb8e44818d36967715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:32Z,use_quota=True,user_id='3ba6007d63d641828a6c6e8c44bd6bdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (590a5cc2-95ff-43da-aafa-993cf858c79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (590a5cc2-95ff-43da-aafa-993cf858c79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bea82f2-09bf-4161-b528-7979fcd0b863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bea82f2-09bf-4161-b528-7979fcd0b863) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81f5b373-02ca-435c-bb1c-e8af6454b484', 'volume_name': 'volume-81f5b373-02ca-435c-bb1c-e8af6454b484', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31dad826-d238-4d3e-aa6f-ea1403021365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31dad826-d238-4d3e-aa6f-ea1403021365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d1f1c6-2dae-4efe-9137-68ce39755210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:32 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] Volume 81f5b373-02ca-435c-bb1c-e8af6454b484: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81f5b373-02ca-435c-bb1c-e8af6454b484', 'volume_size': 1} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6017d183-7cc5-4ca1-8be1-67e778b2303d tempest-CreateVolumesFromImageTest-920449825 None] Acquiring lock "cinder-quobyte-5c2cb208-c44e-4195-b2f3-a515f5cce8d7" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6017d183-7cc5-4ca1-8be1-67e778b2303d tempest-CreateVolumesFromImageTest-920449825 None] Lock "cinder-quobyte-5c2cb208-c44e-4195-b2f3-a515f5cce8d7" acquired by "delete_volume" :: waited 0.017s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[33631b7d-8e44-4955-866d-4807d8913968]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6017d183-7cc5-4ca1-8be1-67e778b2303d tempest-CreateVolumesFromImageTest-920449825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5c2cb208-c44e-4195-b2f3-a515f5cce8d7 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:32 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-816589b6-7018-463a-8c8a-4521416913de 1G" returned: 0 in 0.496s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.volume.volume_utils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Downloaded image 239bcbb3-ccda-45dd-91ae-3b1327590f14 ((None, [{'url': 'file:///opt/stack/data/glance/images/239bcbb3-ccda-45dd-91ae-3b1327590f14', 'metadata': {}}])) to volume 816589b6-7018-463a-8c8a-4521416913de successfully. {{(pid=86703) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Temporary image 239bcbb3-ccda-45dd-91ae-3b1327590f14 for user f2ccab74187c4b4b92664b2712282bde is deleted. {{(pid=86703) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.volume.volume_utils [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Marking volume 816589b6-7018-463a-8c8a-4521416913de as bootable. {{(pid=86703) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Copying metadata from image 239bcbb3-ccda-45dd-91ae-3b1327590f14 to 816589b6-7018-463a-8c8a-4521416913de. {{(pid=86703) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 15:50:32 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Creating volume glance metadata for volume 816589b6-7018-463a-8c8a-4521416913de backed by image 239bcbb3-ccda-45dd-91ae-3b1327590f14 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '239bcbb3-ccda-45dd-91ae-3b1327590f14', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5827c17d920c2cc63afa32bc7e8e082a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86703) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 15:50:32 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5c2cb208-c44e-4195-b2f3-a515f5cce8d7 Nov 02 15:50:32 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] Flow 'volume_create_manager' (8fe5ba1f-4082-4acb-bd92-cacd3f30bf23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c1f209d-6a70-47b3-8200-7d7d0d6129cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (187e62fd-8201-4536-a6bb-5d4698a38a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-816589b6-7018-463a-8c8a-4521416913de', 'volume_size': 1, 'image_id': '239bcbb3-ccda-45dd-91ae-3b1327590f14', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/239bcbb3-ccda-45dd-91ae-3b1327590f14', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5827c17d920c2cc63afa32bc7e8e082a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2665d6c9058c489d89efc4a64fd4e904', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3e7ec6b24a8a2229ddd00badb22518a79c39df0b2c265006de6e71dc051abe4f2971c69d5be79700215f3b507a84a54d2a4ce1d94f1dc139c10318875f45fd82', 'id': '239bcbb3-ccda-45dd-91ae-3b1327590f14', 'created_at': datetime.datetime(2026, 11, 2, 14, 50, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 14, 50, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/239bcbb3-ccda-45dd-91ae-3b1327590f14/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (052e504c-e5ae-4873-af7b-12c61074aeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c1f209d-6a70-47b3-8200-7d7d0d6129cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1481943413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29a91fb9-9698-4e36-a41f-dbad7d01ec46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c7c2100523643bb8e44818d36967715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:33Z,use_quota=True,user_id='3ba6007d63d641828a6c6e8c44bd6bdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76aaaa25-cbfc-4152-bc85-4dececa03b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76aaaa25-cbfc-4152-bc85-4dececa03b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ded068e3-b52a-4bd8-9ce9-5c894567d451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ded068e3-b52a-4bd8-9ce9-5c894567d451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29a91fb9-9698-4e36-a41f-dbad7d01ec46', 'volume_name': 'volume-29a91fb9-9698-4e36-a41f-dbad7d01ec46', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (995271e5-e9e5-434a-b292-f4f6687faeaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:33 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (995271e5-e9e5-434a-b292-f4f6687faeaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b74ee44-4992-43bd-946e-05a0dc09c65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:33 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] Volume 29a91fb9-9698-4e36-a41f-dbad7d01ec46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29a91fb9-9698-4e36-a41f-dbad7d01ec46', 'volume_size': 1} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f61aa4ac-d4dd-47ae-baad-62f7501baa6f 1073741824" returned: 0 in 0.630s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:33 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Volume volume-816589b6-7018-463a-8c8a-4521416913de (816589b6-7018-463a-8c8a-4521416913de): created successfully Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (052e504c-e5ae-4873-af7b-12c61074aeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Flow 'volume_create_manager' (ce650c1e-c4e9-4541-b0b0-11ff1291b181) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:33 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-3e1177f6-e490-403b-b549-a46942439ecd tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Created volume successfully. Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f61aa4ac-d4dd-47ae-baad-62f7501baa6f {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:33 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f61aa4ac-d4dd-47ae-baad-62f7501baa6f Nov 02 15:50:33 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:33 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6017d183-7cc5-4ca1-8be1-67e778b2303d tempest-CreateVolumesFromImageTest-920449825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5c2cb208-c44e-4195-b2f3-a515f5cce8d7" returned: 0 in 0.535s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6017d183-7cc5-4ca1-8be1-67e778b2303d tempest-CreateVolumesFromImageTest-920449825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5c2cb208-c44e-4195-b2f3-a515f5cce8d7 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:33 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5c2cb208-c44e-4195-b2f3-a515f5cce8d7 Nov 02 15:50:33 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-30eae207-88e5-4d0b-8a3d-058e6c852caf tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Acquiring lock "cinder-816589b6-7018-463a-8c8a-4521416913de-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-30eae207-88e5-4d0b-8a3d-058e6c852caf tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Lock "cinder-816589b6-7018-463a-8c8a-4521416913de-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-30eae207-88e5-4d0b-8a3d-058e6c852caf tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Acquiring lock "cinder-quobyte-816589b6-7018-463a-8c8a-4521416913de" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-30eae207-88e5-4d0b-8a3d-058e6c852caf tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Lock "cinder-quobyte-816589b6-7018-463a-8c8a-4521416913de" acquired by "delete_volume" :: waited 0.025s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab78bc9-6bfd-4416-add3-542b18dcf41b]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-30eae207-88e5-4d0b-8a3d-058e6c852caf tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-816589b6-7018-463a-8c8a-4521416913de {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-beef021c-6f7d-4eec-9daa-24b75162580a tempest-ProjectReaderTests-665207650 None] Acquiring lock "cinder-191cb20a-64b5-45e7-8214-0382d32c9869-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:33 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f61aa4ac-d4dd-47ae-baad-62f7501baa6f" returned: 0 in 0.339s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.967s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-669116990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3767bd6a-0ff7-4583-9392-3a6e5bf912fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c7c2100523643bb8e44818d36967715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:31Z,use_quota=True,user_id='3ba6007d63d641828a6c6e8c44bd6bdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Creating volume 3767bd6a-0ff7-4583-9392-3a6e5bf912fb {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:50:33 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3767bd6a-0ff7-4583-9392-3a6e5bf912fb 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-beef021c-6f7d-4eec-9daa-24b75162580a tempest-ProjectReaderTests-665207650 None] Lock "cinder-191cb20a-64b5-45e7-8214-0382d32c9869-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-beef021c-6f7d-4eec-9daa-24b75162580a tempest-ProjectReaderTests-665207650 None] Acquiring lock "cinder-quobyte-8a038b3f-1d16-4c33-93b9-c666ae3e5251" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ad2b2ef-d2af-4402-b9c2-9ee25300277e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f61aa4ac-d4dd-47ae-baad-62f7501baa6f', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c05715c-ede3-46ee-a970-09a902f426d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:33 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3767bd6a-0ff7-4583-9392-3a6e5bf912fb 1073741824 Nov 02 15:50:33 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-816589b6-7018-463a-8c8a-4521416913de Nov 02 15:50:33 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:33 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:33 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] Volume volume-f61aa4ac-d4dd-47ae-baad-62f7501baa6f (f61aa4ac-d4dd-47ae-baad-62f7501baa6f): created successfully Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c05715c-ede3-46ee-a970-09a902f426d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] Flow 'volume_create_manager' (613470c3-3b08-4877-a2ac-0968de26c366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-beef021c-6f7d-4eec-9daa-24b75162580a tempest-ProjectReaderTests-665207650 None] Lock "cinder-quobyte-8a038b3f-1d16-4c33-93b9-c666ae3e5251" acquired by "delete_snapshot" :: waited 0.054s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-beef021c-6f7d-4eec-9daa-24b75162580a tempest-ProjectReaderTests-665207650 None] Acquiring lock "cinder-quobyte-191cb20a-64b5-45e7-8214-0382d32c9869" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:33 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-70d71a15-78ac-463f-b854-cb409bce0cf4 tempest-CreateVolumesFromSnapshotTest-337369598 None] Created volume successfully. Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-beef021c-6f7d-4eec-9daa-24b75162580a tempest-ProjectReaderTests-665207650 None] Lock "cinder-quobyte-191cb20a-64b5-45e7-8214-0382d32c9869" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-beef021c-6f7d-4eec-9daa-24b75162580a tempest-ProjectReaderTests-665207650 None] Deleting offline snapshot 191cb20a-64b5-45e7-8214-0382d32c9869 of volume 8a038b3f-1d16-4c33-93b9-c666ae3e5251 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:50:33 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-beef021c-6f7d-4eec-9daa-24b75162580a tempest-ProjectReaderTests-665207650 None] snapshot_file for this snap is: volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251.191cb20a-64b5-45e7-8214-0382d32c9869 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6017d183-7cc5-4ca1-8be1-67e778b2303d tempest-CreateVolumesFromImageTest-920449825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5c2cb208-c44e-4195-b2f3-a515f5cce8d7" returned: 0 in 0.427s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1369b86-b5df-4490-9266-129b5f52a9f6]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-beef021c-6f7d-4eec-9daa-24b75162580a tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251.191cb20a-64b5-45e7-8214-0382d32c9869 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6017d183-7cc5-4ca1-8be1-67e778b2303d tempest-CreateVolumesFromImageTest-920449825 None] Lock "cinder-quobyte-5c2cb208-c44e-4195-b2f3-a515f5cce8d7" released by "delete_volume" :: held 1.031s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-6017d183-7cc5-4ca1-8be1-67e778b2303d tempest-CreateVolumesFromImageTest-920449825 None] Created reservations ['ced809a4-8e1b-4866-ad07-36f157e1c95d', '82187992-0525-4f6d-8cba-2ca4f01f5959', 'b3c5fdaf-77f0-414f-9b7f-ba496e3573d5', 'f08c6e17-0a79-461f-b324-1f8e8f33b388'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:50:33 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251.191cb20a-64b5-45e7-8214-0382d32c9869 Nov 02 15:50:33 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-6017d183-7cc5-4ca1-8be1-67e778b2303d tempest-CreateVolumesFromImageTest-920449825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-6017d183-7cc5-4ca1-8be1-67e778b2303d tempest-CreateVolumesFromImageTest-920449825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-6017d183-7cc5-4ca1-8be1-67e778b2303d tempest-CreateVolumesFromImageTest-920449825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-6017d183-7cc5-4ca1-8be1-67e778b2303d tempest-CreateVolumesFromImageTest-920449825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-6017d183-7cc5-4ca1-8be1-67e778b2303d tempest-CreateVolumesFromImageTest-920449825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6017d183-7cc5-4ca1-8be1-67e778b2303d tempest-CreateVolumesFromImageTest-920449825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:33 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-30eae207-88e5-4d0b-8a3d-058e6c852caf tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-816589b6-7018-463a-8c8a-4521416913de" returned: 0 in 0.475s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-30eae207-88e5-4d0b-8a3d-058e6c852caf tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-816589b6-7018-463a-8c8a-4521416913de {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:33 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:50:33 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:34 devstack sudo[106690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-816589b6-7018-463a-8c8a-4521416913de Nov 02 15:50:34 devstack sudo[106690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:34 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-beef021c-6f7d-4eec-9daa-24b75162580a tempest-ProjectReaderTests-665207650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251.191cb20a-64b5-45e7-8214-0382d32c9869" returned: 0 in 0.426s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-beef021c-6f7d-4eec-9daa-24b75162580a tempest-ProjectReaderTests-665207650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:50:34 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3767bd6a-0ff7-4583-9392-3a6e5bf912fb 1073741824" returned: 0 in 0.635s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3224a04d-ba51-44dd-9bd7-f43f6f7d5943]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-beef021c-6f7d-4eec-9daa-24b75162580a tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:34 devstack sudo[106690]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-30eae207-88e5-4d0b-8a3d-058e6c852caf tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-816589b6-7018-463a-8c8a-4521416913de" returned: 0 in 0.303s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-30eae207-88e5-4d0b-8a3d-058e6c852caf tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Lock "cinder-quobyte-816589b6-7018-463a-8c8a-4521416913de" released by "delete_volume" :: held 0.851s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3767bd6a-0ff7-4583-9392-3a6e5bf912fb {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:34 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6017d183-7cc5-4ca1-8be1-67e778b2303d tempest-CreateVolumesFromImageTest-920449825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.378s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-6017d183-7cc5-4ca1-8be1-67e778b2303d tempest-CreateVolumesFromImageTest-920449825 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:50:34 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3767bd6a-0ff7-4583-9392-3a6e5bf912fb Nov 02 15:50:34 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:34 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-6017d183-7cc5-4ca1-8be1-67e778b2303d tempest-CreateVolumesFromImageTest-920449825 None] Deleted volume successfully. Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6017d183-7cc5-4ca1-8be1-67e778b2303d tempest-CreateVolumesFromImageTest-920449825 None] Lock "cinder-5c2cb208-c44e-4195-b2f3-a515f5cce8d7-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:34 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251 Nov 02 15:50:34 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-30eae207-88e5-4d0b-8a3d-058e6c852caf tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Created reservations ['3141361d-e5ca-4ccf-843e-ecd0e4119984', '362eec79-ffd6-46b0-9cef-9ef0c6251822', 'c7a5ee16-66a5-48f9-8dc4-08790409b040', '3fc411c0-5680-4db2-832b-9d67fbfb75d3'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-30eae207-88e5-4d0b-8a3d-058e6c852caf tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-30eae207-88e5-4d0b-8a3d-058e6c852caf tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-30eae207-88e5-4d0b-8a3d-058e6c852caf tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-30eae207-88e5-4d0b-8a3d-058e6c852caf tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-30eae207-88e5-4d0b-8a3d-058e6c852caf tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-30eae207-88e5-4d0b-8a3d-058e6c852caf tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:34 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:50:34 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:34 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3767bd6a-0ff7-4583-9392-3a6e5bf912fb" returned: 0 in 0.318s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.355s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-454955961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd0178b3-6ba1-4cea-afce-431a3e219b84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c7c2100523643bb8e44818d36967715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:32Z,use_quota=True,user_id='3ba6007d63d641828a6c6e8c44bd6bdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] Creating volume fd0178b3-6ba1-4cea-afce-431a3e219b84 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:50:34 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-fd0178b3-6ba1-4cea-afce-431a3e219b84 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (988a973a-a9ee-4bc7-90f9-9e9e9438dd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3767bd6a-0ff7-4583-9392-3a6e5bf912fb', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:34 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-fd0178b3-6ba1-4cea-afce-431a3e219b84 1073741824 Nov 02 15:50:34 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:34 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed03c80-4cd9-43c4-bd69-92ef8687075a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-beef021c-6f7d-4eec-9daa-24b75162580a tempest-ProjectReaderTests-665207650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251" returned: 0 in 0.466s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-beef021c-6f7d-4eec-9daa-24b75162580a tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251.191cb20a-64b5-45e7-8214-0382d32c9869 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:34 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Volume volume-3767bd6a-0ff7-4583-9392-3a6e5bf912fb (3767bd6a-0ff7-4583-9392-3a6e5bf912fb): created successfully Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ed03c80-4cd9-43c4-bd69-92ef8687075a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Flow 'volume_create_manager' (fabf89bc-bc10-499f-8cab-4e94d0c34541) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:34 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251.191cb20a-64b5-45e7-8214-0382d32c9869 Nov 02 15:50:34 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:34 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-f7181ba6-d70e-4268-b8eb-cb54b45e8df7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Created volume successfully. Nov 02 15:50:34 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-30eae207-88e5-4d0b-8a3d-058e6c852caf tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.354s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-30eae207-88e5-4d0b-8a3d-058e6c852caf tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:50:34 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-30eae207-88e5-4d0b-8a3d-058e6c852caf tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Deleted volume successfully. Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-30eae207-88e5-4d0b-8a3d-058e6c852caf tempest-VolumeAndVolumeTypeFromImageTest-1172130166 None] Lock "cinder-816589b6-7018-463a-8c8a-4521416913de-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c6dd4a5e-c345-4681-9c92-3e357c0a4567 tempest-CreateVolumesFromImageTest-920449825 None] Acquiring lock "cinder-5e328351-18e8-4b8f-8408-407edd005c64-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:34 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c6dd4a5e-c345-4681-9c92-3e357c0a4567 tempest-CreateVolumesFromImageTest-920449825 None] Lock "cinder-5e328351-18e8-4b8f-8408-407edd005c64-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c6dd4a5e-c345-4681-9c92-3e357c0a4567 tempest-CreateVolumesFromImageTest-920449825 None] Acquiring lock "cinder-quobyte-5e328351-18e8-4b8f-8408-407edd005c64" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c6dd4a5e-c345-4681-9c92-3e357c0a4567 tempest-CreateVolumesFromImageTest-920449825 None] Lock "cinder-quobyte-5e328351-18e8-4b8f-8408-407edd005c64" acquired by "delete_volume" :: waited 0.019s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee8a377-4ccb-4463-9a34-0db2fd21c1f1]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c6dd4a5e-c345-4681-9c92-3e357c0a4567 tempest-CreateVolumesFromImageTest-920449825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e328351-18e8-4b8f-8408-407edd005c64 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:35 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e328351-18e8-4b8f-8408-407edd005c64 Nov 02 15:50:35 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:35 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-beef021c-6f7d-4eec-9daa-24b75162580a tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251.191cb20a-64b5-45e7-8214-0382d32c9869" returned: 0 in 0.536s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-beef021c-6f7d-4eec-9daa-24b75162580a tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251.191cb20a-64b5-45e7-8214-0382d32c9869 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:35 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251.191cb20a-64b5-45e7-8214-0382d32c9869 Nov 02 15:50:35 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:35 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-fd0178b3-6ba1-4cea-afce-431a3e219b84 1073741824" returned: 0 in 0.698s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-fd0178b3-6ba1-4cea-afce-431a3e219b84 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:35 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-fd0178b3-6ba1-4cea-afce-431a3e219b84 Nov 02 15:50:35 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:35 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c6dd4a5e-c345-4681-9c92-3e357c0a4567 tempest-CreateVolumesFromImageTest-920449825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e328351-18e8-4b8f-8408-407edd005c64" returned: 0 in 0.432s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c6dd4a5e-c345-4681-9c92-3e357c0a4567 tempest-CreateVolumesFromImageTest-920449825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e328351-18e8-4b8f-8408-407edd005c64 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:35 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-beef021c-6f7d-4eec-9daa-24b75162580a tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251.191cb20a-64b5-45e7-8214-0382d32c9869" returned: 0 in 0.313s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:35 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e328351-18e8-4b8f-8408-407edd005c64 Nov 02 15:50:35 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-beef021c-6f7d-4eec-9daa-24b75162580a tempest-ProjectReaderTests-665207650 None] Lock "cinder-quobyte-191cb20a-64b5-45e7-8214-0382d32c9869" released by "_delete_snapshot" :: held 1.904s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-beef021c-6f7d-4eec-9daa-24b75162580a tempest-ProjectReaderTests-665207650 None] Lock "cinder-quobyte-8a038b3f-1d16-4c33-93b9-c666ae3e5251" released by "delete_snapshot" :: held 1.955s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:35 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-fd0178b3-6ba1-4cea-afce-431a3e219b84" returned: 0 in 0.309s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.991s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1313548549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81f5b373-02ca-435c-bb1c-e8af6454b484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c7c2100523643bb8e44818d36967715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:32Z,use_quota=True,user_id='3ba6007d63d641828a6c6e8c44bd6bdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] Creating volume 81f5b373-02ca-435c-bb1c-e8af6454b484 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:50:35 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-81f5b373-02ca-435c-bb1c-e8af6454b484 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c807284-89a2-461f-8a12-b2c316b68791) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd0178b3-6ba1-4cea-afce-431a3e219b84', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:35 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-81f5b373-02ca-435c-bb1c-e8af6454b484 1073741824 Nov 02 15:50:35 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dc1cc36-f004-4736-bfde-6eba9cd67579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:35 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] Volume volume-fd0178b3-6ba1-4cea-afce-431a3e219b84 (fd0178b3-6ba1-4cea-afce-431a3e219b84): created successfully Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dc1cc36-f004-4736-bfde-6eba9cd67579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] Flow 'volume_create_manager' (de871f40-00f5-43d6-9e4a-6124ce497fe9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:35 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-c4cf2f3d-c2c6-4e97-8fab-6bd1e30bbc24 tempest-CreateVolumesFromSnapshotTest-337369598 None] Created volume successfully. Nov 02 15:50:35 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c6dd4a5e-c345-4681-9c92-3e357c0a4567 tempest-CreateVolumesFromImageTest-920449825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e328351-18e8-4b8f-8408-407edd005c64" returned: 0 in 0.324s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-beef021c-6f7d-4eec-9daa-24b75162580a tempest-ProjectReaderTests-665207650 None] Created reservations ['c4e88cd1-1b02-4502-8cc8-51c481738683', '832ac23f-3278-4e82-bddd-a0b256316c46', '657cf124-2828-4578-98f7-6947f95a1790', '3e91a0a7-f5ea-4e2e-aef7-dd1ba9e1e7d6'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c6dd4a5e-c345-4681-9c92-3e357c0a4567 tempest-CreateVolumesFromImageTest-920449825 None] Lock "cinder-quobyte-5e328351-18e8-4b8f-8408-407edd005c64" released by "delete_volume" :: held 0.828s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:35 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-beef021c-6f7d-4eec-9daa-24b75162580a tempest-ProjectReaderTests-665207650 None] Delete snapshot completed successfully. Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-beef021c-6f7d-4eec-9daa-24b75162580a tempest-ProjectReaderTests-665207650 None] Lock "cinder-191cb20a-64b5-45e7-8214-0382d32c9869-delete_snapshot" released by "delete_snapshot" :: held 2.381s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:35 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-c6dd4a5e-c345-4681-9c92-3e357c0a4567 tempest-CreateVolumesFromImageTest-920449825 None] Created reservations ['45b15a6f-8b67-4ef5-b284-5b3a90de777a', 'a1374843-d744-4604-823e-9d4d7f3c3ec0', '568cf000-35ab-44db-a43e-6f14a5ea97da', '62cf78ee-80e8-404b-b9a5-82c5f1e4323b'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:50:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c6dd4a5e-c345-4681-9c92-3e357c0a4567 tempest-CreateVolumesFromImageTest-920449825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c6dd4a5e-c345-4681-9c92-3e357c0a4567 tempest-CreateVolumesFromImageTest-920449825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:36 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c6dd4a5e-c345-4681-9c92-3e357c0a4567 tempest-CreateVolumesFromImageTest-920449825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:36 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c6dd4a5e-c345-4681-9c92-3e357c0a4567 tempest-CreateVolumesFromImageTest-920449825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c6dd4a5e-c345-4681-9c92-3e357c0a4567 tempest-CreateVolumesFromImageTest-920449825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c6dd4a5e-c345-4681-9c92-3e357c0a4567 tempest-CreateVolumesFromImageTest-920449825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:36 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:50:36 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:36 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-81f5b373-02ca-435c-bb1c-e8af6454b484 1073741824" returned: 0 in 0.642s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-81f5b373-02ca-435c-bb1c-e8af6454b484 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:36 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c6dd4a5e-c345-4681-9c92-3e357c0a4567 tempest-CreateVolumesFromImageTest-920449825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.368s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:36 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-c6dd4a5e-c345-4681-9c92-3e357c0a4567 tempest-CreateVolumesFromImageTest-920449825 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:50:36 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-81f5b373-02ca-435c-bb1c-e8af6454b484 Nov 02 15:50:36 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:36 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-c6dd4a5e-c345-4681-9c92-3e357c0a4567 tempest-CreateVolumesFromImageTest-920449825 None] Deleted volume successfully. Nov 02 15:50:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c6dd4a5e-c345-4681-9c92-3e357c0a4567 tempest-CreateVolumesFromImageTest-920449825 None] Lock "cinder-5e328351-18e8-4b8f-8408-407edd005c64-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:36 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-81f5b373-02ca-435c-bb1c-e8af6454b484" returned: 0 in 0.299s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:36 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:50:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.539s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:36 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1481943413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29a91fb9-9698-4e36-a41f-dbad7d01ec46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c7c2100523643bb8e44818d36967715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:33Z,use_quota=True,user_id='3ba6007d63d641828a6c6e8c44bd6bdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:50:36 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] Creating volume 29a91fb9-9698-4e36-a41f-dbad7d01ec46 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:50:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:36 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:36 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:36 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:50:36 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:50:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-29a91fb9-9698-4e36-a41f-dbad7d01ec46 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:36 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-29a91fb9-9698-4e36-a41f-dbad7d01ec46 1073741824 Nov 02 15:50:36 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:36 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9d1f1c6-2dae-4efe-9137-68ce39755210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81f5b373-02ca-435c-bb1c-e8af6454b484', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:36 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f86a64d7-3f4e-47a3-a15f-18e90d988230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:36 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] Volume volume-81f5b373-02ca-435c-bb1c-e8af6454b484 (81f5b373-02ca-435c-bb1c-e8af6454b484): created successfully Nov 02 15:50:36 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f86a64d7-3f4e-47a3-a15f-18e90d988230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:36 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] Flow 'volume_create_manager' (7422fa3c-8cf7-4292-8ce8-2a612c84fd25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b0d900be-725b-4b33-b46d-ca3ab8bc4c26 tempest-ProjectReaderTests-665207650 None] Acquiring lock "cinder-8a038b3f-1d16-4c33-93b9-c666ae3e5251-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:36 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-672fa3ac-7bb8-43fa-ba72-838750252a55 tempest-CreateVolumesFromSnapshotTest-337369598 None] Created volume successfully. Nov 02 15:50:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b0d900be-725b-4b33-b46d-ca3ab8bc4c26 tempest-ProjectReaderTests-665207650 None] Lock "cinder-8a038b3f-1d16-4c33-93b9-c666ae3e5251-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b0d900be-725b-4b33-b46d-ca3ab8bc4c26 tempest-ProjectReaderTests-665207650 None] Acquiring lock "cinder-quobyte-8a038b3f-1d16-4c33-93b9-c666ae3e5251" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b0d900be-725b-4b33-b46d-ca3ab8bc4c26 tempest-ProjectReaderTests-665207650 None] Lock "cinder-quobyte-8a038b3f-1d16-4c33-93b9-c666ae3e5251" acquired by "delete_volume" :: waited 0.025s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:37 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1227884e-9266-4de1-ad9f-ed95312b7853]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b0d900be-725b-4b33-b46d-ca3ab8bc4c26 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:37 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251 Nov 02 15:50:37 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:37 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-29a91fb9-9698-4e36-a41f-dbad7d01ec46 1073741824" returned: 0 in 0.524s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-29a91fb9-9698-4e36-a41f-dbad7d01ec46 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:37 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-29a91fb9-9698-4e36-a41f-dbad7d01ec46 Nov 02 15:50:37 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:37 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b0d900be-725b-4b33-b46d-ca3ab8bc4c26 tempest-ProjectReaderTests-665207650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251" returned: 0 in 0.431s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b0d900be-725b-4b33-b46d-ca3ab8bc4c26 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:37 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251 Nov 02 15:50:37 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:37 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-29a91fb9-9698-4e36-a41f-dbad7d01ec46" returned: 0 in 0.351s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:50:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b74ee44-4992-43bd-946e-05a0dc09c65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29a91fb9-9698-4e36-a41f-dbad7d01ec46', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80be5fa2-738a-4af1-9b24-930d658163a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:37 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b0d900be-725b-4b33-b46d-ca3ab8bc4c26 tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-8a038b3f-1d16-4c33-93b9-c666ae3e5251" returned: 0 in 0.321s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:37 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] Volume volume-29a91fb9-9698-4e36-a41f-dbad7d01ec46 (29a91fb9-9698-4e36-a41f-dbad7d01ec46): created successfully Nov 02 15:50:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80be5fa2-738a-4af1-9b24-930d658163a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:37 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] Flow 'volume_create_manager' (8fe5ba1f-4082-4acb-bd92-cacd3f30bf23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:37 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b0d900be-725b-4b33-b46d-ca3ab8bc4c26 tempest-ProjectReaderTests-665207650 None] Lock "cinder-quobyte-8a038b3f-1d16-4c33-93b9-c666ae3e5251" released by "delete_volume" :: held 0.860s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:37 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-ceea8e58-4403-4e45-aa06-e3dfb68af1f1 tempest-CreateVolumesFromSnapshotTest-337369598 None] Created volume successfully. Nov 02 15:50:37 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-b0d900be-725b-4b33-b46d-ca3ab8bc4c26 tempest-ProjectReaderTests-665207650 None] Created reservations ['2f56975d-02ec-473f-a9e6-d61522636e42', '60045e97-cff9-48ac-923f-df7e4ebc3c5d', '07a8be5b-0dcd-4bd3-a1bc-4a032926d369', 'b21c2f83-ee44-4ebe-9d7e-7a607ad191c9'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:50:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b0d900be-725b-4b33-b46d-ca3ab8bc4c26 tempest-ProjectReaderTests-665207650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b0d900be-725b-4b33-b46d-ca3ab8bc4c26 tempest-ProjectReaderTests-665207650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b0d900be-725b-4b33-b46d-ca3ab8bc4c26 tempest-ProjectReaderTests-665207650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:37 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b0d900be-725b-4b33-b46d-ca3ab8bc4c26 tempest-ProjectReaderTests-665207650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b0d900be-725b-4b33-b46d-ca3ab8bc4c26 tempest-ProjectReaderTests-665207650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b0d900be-725b-4b33-b46d-ca3ab8bc4c26 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:38 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:50:38 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:38 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b0d900be-725b-4b33-b46d-ca3ab8bc4c26 tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.287s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:38 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-b0d900be-725b-4b33-b46d-ca3ab8bc4c26 tempest-ProjectReaderTests-665207650 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:50:38 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-b0d900be-725b-4b33-b46d-ca3ab8bc4c26 tempest-ProjectReaderTests-665207650 None] Deleted volume successfully. Nov 02 15:50:38 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b0d900be-725b-4b33-b46d-ca3ab8bc4c26 tempest-ProjectReaderTests-665207650 None] Lock "cinder-8a038b3f-1d16-4c33-93b9-c666ae3e5251-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:38 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:50:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] Flow 'volume_create_manager' (81d1301d-eb28-445d-baf2-81f2048e0a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f0121c-132d-43ab-bbae-74cc0b819738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29f0121c-132d-43ab-bbae-74cc0b819738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1760286260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8760ef4-0c46-498e-ad8d-d1c405f56fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081ecbd5e3694d9d9779db39943c12e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:39Z,use_quota=True,user_id='c8c5dd94e82a45439e6816d23423ecdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (323f34d7-d1d6-4f9b-8ca4-8967fadc5659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (323f34d7-d1d6-4f9b-8ca4-8967fadc5659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22721ac-e9a8-41cf-b520-7498c7b4f508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b22721ac-e9a8-41cf-b520-7498c7b4f508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8760ef4-0c46-498e-ad8d-d1c405f56fb6', 'volume_name': 'volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb709eb9-bd0d-42d4-8fd4-331bccc57fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb709eb9-bd0d-42d4-8fd4-331bccc57fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a143a3f-c192-4ae8-9427-18ba97fa36ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:38 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] Volume a8760ef4-0c46-498e-ad8d-d1c405f56fb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6', 'volume_size': 1} Nov 02 15:50:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1760286260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8760ef4-0c46-498e-ad8d-d1c405f56fb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081ecbd5e3694d9d9779db39943c12e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:39Z,use_quota=True,user_id='c8c5dd94e82a45439e6816d23423ecdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:50:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] Creating volume a8760ef4-0c46-498e-ad8d-d1c405f56fb6 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:50:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:50:38 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:50:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:38 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b307aef1-7c16-42eb-872b-06d5ef89fc44 tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "cinder-29a91fb9-9698-4e36-a41f-dbad7d01ec46-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:38 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6 1073741824 Nov 02 15:50:38 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:38 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b307aef1-7c16-42eb-872b-06d5ef89fc44 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "cinder-29a91fb9-9698-4e36-a41f-dbad7d01ec46-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:38 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b307aef1-7c16-42eb-872b-06d5ef89fc44 tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "cinder-quobyte-29a91fb9-9698-4e36-a41f-dbad7d01ec46" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:38 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b307aef1-7c16-42eb-872b-06d5ef89fc44 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "cinder-quobyte-29a91fb9-9698-4e36-a41f-dbad7d01ec46" acquired by "delete_volume" :: waited 0.026s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:38 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a45c267-1a13-4c89-9a8e-5abaf5536891]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b307aef1-7c16-42eb-872b-06d5ef89fc44 tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-29a91fb9-9698-4e36-a41f-dbad7d01ec46 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:39 devstack sudo[106769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-29a91fb9-9698-4e36-a41f-dbad7d01ec46 Nov 02 15:50:39 devstack sudo[106769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:39 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6 1073741824" returned: 0 in 0.546s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:39 devstack sudo[106769]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b307aef1-7c16-42eb-872b-06d5ef89fc44 tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-29a91fb9-9698-4e36-a41f-dbad7d01ec46" returned: 0 in 0.394s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b307aef1-7c16-42eb-872b-06d5ef89fc44 tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-29a91fb9-9698-4e36-a41f-dbad7d01ec46 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:39 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-29a91fb9-9698-4e36-a41f-dbad7d01ec46 Nov 02 15:50:39 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:39 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6 Nov 02 15:50:39 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:39 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b307aef1-7c16-42eb-872b-06d5ef89fc44 tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-29a91fb9-9698-4e36-a41f-dbad7d01ec46" returned: 0 in 0.336s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:39 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6" returned: 0 in 0.291s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:39 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:50:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b307aef1-7c16-42eb-872b-06d5ef89fc44 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "cinder-quobyte-29a91fb9-9698-4e36-a41f-dbad7d01ec46" released by "delete_volume" :: held 0.799s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:39 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a143a3f-c192-4ae8-9427-18ba97fa36ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:39 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60851ca8-8de9-4aaa-9912-66d768363cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:39 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] Volume volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6 (a8760ef4-0c46-498e-ad8d-d1c405f56fb6): created successfully Nov 02 15:50:39 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60851ca8-8de9-4aaa-9912-66d768363cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:39 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] Flow 'volume_create_manager' (81d1301d-eb28-445d-baf2-81f2048e0a27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:39 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-2d4d61cd-d13f-4afe-8f2c-d05e20ad234f tempest-ProjectReaderTests-665207650 None] Created volume successfully. Nov 02 15:50:39 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-b307aef1-7c16-42eb-872b-06d5ef89fc44 tempest-CreateVolumesFromSnapshotTest-337369598 None] Created reservations ['72cca84f-f8f2-4270-829a-884ddfc64abd', '9bbdbfc0-6b90-4c52-91ac-39bb59828148', 'ac668297-ec66-4559-b6c9-75b527e9e9b4', 'b90ad515-aa1a-4ead-9ad0-f547278a83d2'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:50:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b307aef1-7c16-42eb-872b-06d5ef89fc44 tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b307aef1-7c16-42eb-872b-06d5ef89fc44 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:39 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b307aef1-7c16-42eb-872b-06d5ef89fc44 tempest-CreateVolumesFromSnapshotTest-337369598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:39 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b307aef1-7c16-42eb-872b-06d5ef89fc44 tempest-CreateVolumesFromSnapshotTest-337369598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b307aef1-7c16-42eb-872b-06d5ef89fc44 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b307aef1-7c16-42eb-872b-06d5ef89fc44 tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:39 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:50:39 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b86aa0c2-36cc-49fc-b4d0-4da75bbf3648 tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "cinder-81f5b373-02ca-435c-bb1c-e8af6454b484-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b86aa0c2-36cc-49fc-b4d0-4da75bbf3648 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "cinder-81f5b373-02ca-435c-bb1c-e8af6454b484-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b86aa0c2-36cc-49fc-b4d0-4da75bbf3648 tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "cinder-quobyte-81f5b373-02ca-435c-bb1c-e8af6454b484" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b86aa0c2-36cc-49fc-b4d0-4da75bbf3648 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "cinder-quobyte-81f5b373-02ca-435c-bb1c-e8af6454b484" acquired by "delete_volume" :: waited 0.016s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:40 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1fcc23-a7ce-4573-a2ba-21f8e745ca21]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b86aa0c2-36cc-49fc-b4d0-4da75bbf3648 tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-81f5b373-02ca-435c-bb1c-e8af6454b484 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:40 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b307aef1-7c16-42eb-872b-06d5ef89fc44 tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.314s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:40 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-b307aef1-7c16-42eb-872b-06d5ef89fc44 tempest-CreateVolumesFromSnapshotTest-337369598 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:50:40 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-b307aef1-7c16-42eb-872b-06d5ef89fc44 tempest-CreateVolumesFromSnapshotTest-337369598 None] Deleted volume successfully. Nov 02 15:50:40 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-81f5b373-02ca-435c-bb1c-e8af6454b484 Nov 02 15:50:40 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b307aef1-7c16-42eb-872b-06d5ef89fc44 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "cinder-29a91fb9-9698-4e36-a41f-dbad7d01ec46-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:40 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b86aa0c2-36cc-49fc-b4d0-4da75bbf3648 tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-81f5b373-02ca-435c-bb1c-e8af6454b484" returned: 0 in 0.405s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b86aa0c2-36cc-49fc-b4d0-4da75bbf3648 tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-81f5b373-02ca-435c-bb1c-e8af6454b484 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:40 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-81f5b373-02ca-435c-bb1c-e8af6454b484 Nov 02 15:50:40 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:40 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b86aa0c2-36cc-49fc-b4d0-4da75bbf3648 tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-81f5b373-02ca-435c-bb1c-e8af6454b484" returned: 0 in 0.319s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b86aa0c2-36cc-49fc-b4d0-4da75bbf3648 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "cinder-quobyte-81f5b373-02ca-435c-bb1c-e8af6454b484" released by "delete_volume" :: held 0.806s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0115b769-a1a9-4816-8d5b-d9e4d0d6cebb tempest-ProjectReaderTests-665207650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0115b769-a1a9-4816-8d5b-d9e4d0d6cebb tempest-ProjectReaderTests-665207650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:40 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-0115b769-a1a9-4816-8d5b-d9e4d0d6cebb tempest-ProjectReaderTests-665207650 None] Creating offline snapshot 41b31b58-24c0-458e-95a6-8eaa3e2c5c00 of volume a8760ef4-0c46-498e-ad8d-d1c405f56fb6 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:50:40 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[381f800f-8b31-4fc8-92ad-37e82349e203]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0115b769-a1a9-4816-8d5b-d9e4d0d6cebb tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-b86aa0c2-36cc-49fc-b4d0-4da75bbf3648 tempest-CreateVolumesFromSnapshotTest-337369598 None] Created reservations ['68c9c76a-19b7-4825-838b-b67d7dd05234', '62eef7e0-2fda-4425-8565-e467241a3ac1', '1a07ffff-c577-4b1d-90b0-e98395908079', 'cea5db74-45c7-4237-b5dd-74065f00d8be'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b86aa0c2-36cc-49fc-b4d0-4da75bbf3648 tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b86aa0c2-36cc-49fc-b4d0-4da75bbf3648 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b86aa0c2-36cc-49fc-b4d0-4da75bbf3648 tempest-CreateVolumesFromSnapshotTest-337369598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b86aa0c2-36cc-49fc-b4d0-4da75bbf3648 tempest-CreateVolumesFromSnapshotTest-337369598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b86aa0c2-36cc-49fc-b4d0-4da75bbf3648 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b86aa0c2-36cc-49fc-b4d0-4da75bbf3648 tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:41 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6 Nov 02 15:50:41 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:41 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:50:41 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Flow 'volume_create_manager' (0437192a-8fad-46c4-8dae-5ffa93093d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9655eb0-9d92-49d4-87bd-e05c34002b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-bc52df6f-c953-46e8-bb6a-6c2059e64f31 tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "cinder-fd0178b3-6ba1-4cea-afce-431a3e219b84-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-bc52df6f-c953-46e8-bb6a-6c2059e64f31 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "cinder-fd0178b3-6ba1-4cea-afce-431a3e219b84-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9655eb0-9d92-49d4-87bd-e05c34002b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1041804228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac6a4a4e-7207-44d3-a267-75ee50ab3256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1ff8a210634e2385bc5d408291ccbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:41Z,use_quota=True,user_id='d7f4888441824e5fa83308a6078c716d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a044ac1-6393-40e5-8945-294ef88f3f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a044ac1-6393-40e5-8945-294ef88f3f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (257e1a33-98e4-4098-86a2-922218eae899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (257e1a33-98e4-4098-86a2-922218eae899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac6a4a4e-7207-44d3-a267-75ee50ab3256', 'volume_name': 'volume-ac6a4a4e-7207-44d3-a267-75ee50ab3256', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06000b7d-c42b-45e8-bf1f-05111d754c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06000b7d-c42b-45e8-bf1f-05111d754c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97fbab4d-6621-4deb-9bcd-97440725ae22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:41 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Volume ac6a4a4e-7207-44d3-a267-75ee50ab3256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac6a4a4e-7207-44d3-a267-75ee50ab3256', 'volume_size': 1} Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-bc52df6f-c953-46e8-bb6a-6c2059e64f31 tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "cinder-quobyte-fd0178b3-6ba1-4cea-afce-431a3e219b84" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-bc52df6f-c953-46e8-bb6a-6c2059e64f31 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "cinder-quobyte-fd0178b3-6ba1-4cea-afce-431a3e219b84" acquired by "delete_volume" :: waited 0.017s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:41 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b86aa0c2-36cc-49fc-b4d0-4da75bbf3648 tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.346s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-b86aa0c2-36cc-49fc-b4d0-4da75bbf3648 tempest-CreateVolumesFromSnapshotTest-337369598 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1664ed-d34b-4969-bb2f-3f53454d42f6]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bc52df6f-c953-46e8-bb6a-6c2059e64f31 tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-fd0178b3-6ba1-4cea-afce-431a3e219b84 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:41 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:41 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-b86aa0c2-36cc-49fc-b4d0-4da75bbf3648 tempest-CreateVolumesFromSnapshotTest-337369598 None] Deleted volume successfully. Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0115b769-a1a9-4816-8d5b-d9e4d0d6cebb tempest-ProjectReaderTests-665207650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6" returned: 0 in 0.495s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0115b769-a1a9-4816-8d5b-d9e4d0d6cebb tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6.41b31b58-24c0-458e-95a6-8eaa3e2c5c00 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:41 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6.41b31b58-24c0-458e-95a6-8eaa3e2c5c00 1G Nov 02 15:50:41 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b86aa0c2-36cc-49fc-b4d0-4da75bbf3648 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "cinder-81f5b373-02ca-435c-bb1c-e8af6454b484-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:41 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-fd0178b3-6ba1-4cea-afce-431a3e219b84 Nov 02 15:50:41 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:41 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bc52df6f-c953-46e8-bb6a-6c2059e64f31 tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-fd0178b3-6ba1-4cea-afce-431a3e219b84" returned: 0 in 0.375s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bc52df6f-c953-46e8-bb6a-6c2059e64f31 tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-fd0178b3-6ba1-4cea-afce-431a3e219b84 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:41 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-fd0178b3-6ba1-4cea-afce-431a3e219b84 Nov 02 15:50:41 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:41 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0115b769-a1a9-4816-8d5b-d9e4d0d6cebb tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6.41b31b58-24c0-458e-95a6-8eaa3e2c5c00 1G" returned: 0 in 0.454s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0115b769-a1a9-4816-8d5b-d9e4d0d6cebb tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6.41b31b58-24c0-458e-95a6-8eaa3e2c5c00 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:41 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6.41b31b58-24c0-458e-95a6-8eaa3e2c5c00 Nov 02 15:50:41 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:42 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bc52df6f-c953-46e8-bb6a-6c2059e64f31 tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-fd0178b3-6ba1-4cea-afce-431a3e219b84" returned: 0 in 0.273s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:42 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-bc52df6f-c953-46e8-bb6a-6c2059e64f31 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "cinder-quobyte-fd0178b3-6ba1-4cea-afce-431a3e219b84" released by "delete_volume" :: held 0.718s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:42 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-bc52df6f-c953-46e8-bb6a-6c2059e64f31 tempest-CreateVolumesFromSnapshotTest-337369598 None] Created reservations ['3f7e4486-09f7-4abe-b4c2-bda7d7cc38de', 'e4bbb8f0-7e78-401d-81e4-3c55277b757b', '0674d73f-e375-4d3b-8e86-e23738aab411', '99869288-5af2-42ba-b470-1ffc912d1921'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:50:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-bc52df6f-c953-46e8-bb6a-6c2059e64f31 tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-bc52df6f-c953-46e8-bb6a-6c2059e64f31 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:42 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-bc52df6f-c953-46e8-bb6a-6c2059e64f31 tempest-CreateVolumesFromSnapshotTest-337369598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:42 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-bc52df6f-c953-46e8-bb6a-6c2059e64f31 tempest-CreateVolumesFromSnapshotTest-337369598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-bc52df6f-c953-46e8-bb6a-6c2059e64f31 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bc52df6f-c953-46e8-bb6a-6c2059e64f31 tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:42 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:50:42 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:42 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0115b769-a1a9-4816-8d5b-d9e4d0d6cebb tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6.41b31b58-24c0-458e-95a6-8eaa3e2c5c00" returned: 0 in 0.349s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:42 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-0115b769-a1a9-4816-8d5b-d9e4d0d6cebb tempest-ProjectReaderTests-665207650 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6.41b31b58-24c0-458e-95a6-8eaa3e2c5c00 is being set with open permissions: ugo+rw Nov 02 15:50:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0115b769-a1a9-4816-8d5b-d9e4d0d6cebb tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6.41b31b58-24c0-458e-95a6-8eaa3e2c5c00 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:42 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6.41b31b58-24c0-458e-95a6-8eaa3e2c5c00 Nov 02 15:50:42 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:42 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d26ae38d-0e73-4bc2-813d-6f4dac0df539 tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "cinder-3767bd6a-0ff7-4583-9392-3a6e5bf912fb-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:42 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:42 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d26ae38d-0e73-4bc2-813d-6f4dac0df539 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "cinder-3767bd6a-0ff7-4583-9392-3a6e5bf912fb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bc52df6f-c953-46e8-bb6a-6c2059e64f31 tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.309s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:42 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-bc52df6f-c953-46e8-bb6a-6c2059e64f31 tempest-CreateVolumesFromSnapshotTest-337369598 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:50:42 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-bc52df6f-c953-46e8-bb6a-6c2059e64f31 tempest-CreateVolumesFromSnapshotTest-337369598 None] Deleted volume successfully. Nov 02 15:50:42 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-bc52df6f-c953-46e8-bb6a-6c2059e64f31 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "cinder-fd0178b3-6ba1-4cea-afce-431a3e219b84-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:42 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0115b769-a1a9-4816-8d5b-d9e4d0d6cebb tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6.41b31b58-24c0-458e-95a6-8eaa3e2c5c00" returned: 0 in 0.322s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:42 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d26ae38d-0e73-4bc2-813d-6f4dac0df539 tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "cinder-quobyte-3767bd6a-0ff7-4583-9392-3a6e5bf912fb" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:42 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d26ae38d-0e73-4bc2-813d-6f4dac0df539 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "cinder-quobyte-3767bd6a-0ff7-4583-9392-3a6e5bf912fb" acquired by "delete_volume" :: waited 0.016s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0115b769-a1a9-4816-8d5b-d9e4d0d6cebb tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:42 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dc8416-1138-4314-9136-2e12eefec378]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d26ae38d-0e73-4bc2-813d-6f4dac0df539 tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3767bd6a-0ff7-4583-9392-3a6e5bf912fb {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:42 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6.info Nov 02 15:50:42 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:42 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3767bd6a-0ff7-4583-9392-3a6e5bf912fb Nov 02 15:50:42 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:42 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0115b769-a1a9-4816-8d5b-d9e4d0d6cebb tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6.info" returned: 0 in 0.267s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:42 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-0115b769-a1a9-4816-8d5b-d9e4d0d6cebb tempest-ProjectReaderTests-665207650 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6.info is being set with open permissions: ugo+rw Nov 02 15:50:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0115b769-a1a9-4816-8d5b-d9e4d0d6cebb tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:42 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6.info Nov 02 15:50:42 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:43 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d26ae38d-0e73-4bc2-813d-6f4dac0df539 tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3767bd6a-0ff7-4583-9392-3a6e5bf912fb" returned: 0 in 0.402s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d26ae38d-0e73-4bc2-813d-6f4dac0df539 tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3767bd6a-0ff7-4583-9392-3a6e5bf912fb {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:43 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3767bd6a-0ff7-4583-9392-3a6e5bf912fb Nov 02 15:50:43 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:43 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0115b769-a1a9-4816-8d5b-d9e4d0d6cebb tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6.info" returned: 0 in 0.291s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0115b769-a1a9-4816-8d5b-d9e4d0d6cebb tempest-ProjectReaderTests-665207650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.293s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.875s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1041804228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac6a4a4e-7207-44d3-a267-75ee50ab3256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1ff8a210634e2385bc5d408291ccbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:41Z,use_quota=True,user_id='d7f4888441824e5fa83308a6078c716d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:50:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Creating volume ac6a4a4e-7207-44d3-a267-75ee50ab3256 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:50:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:50:43 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:50:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ac6a4a4e-7207-44d3-a267-75ee50ab3256 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:43 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ac6a4a4e-7207-44d3-a267-75ee50ab3256 1073741824 Nov 02 15:50:43 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:43 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-0115b769-a1a9-4816-8d5b-d9e4d0d6cebb tempest-ProjectReaderTests-665207650 None] Create snapshot completed successfully Nov 02 15:50:43 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d26ae38d-0e73-4bc2-813d-6f4dac0df539 tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-3767bd6a-0ff7-4583-9392-3a6e5bf912fb" returned: 0 in 0.284s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:43 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d26ae38d-0e73-4bc2-813d-6f4dac0df539 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "cinder-quobyte-3767bd6a-0ff7-4583-9392-3a6e5bf912fb" released by "delete_volume" :: held 0.736s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:43 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-d26ae38d-0e73-4bc2-813d-6f4dac0df539 tempest-CreateVolumesFromSnapshotTest-337369598 None] Created reservations ['babdf7ca-223a-45f7-9600-76f569f8bd5a', '26e58e75-8c6d-4b2b-a522-f75386640978', '9c59140c-c998-4497-acd4-83a508f4acb6', '5a470e58-9e82-4705-adf8-03d62dbe10d9'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:50:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d26ae38d-0e73-4bc2-813d-6f4dac0df539 tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d26ae38d-0e73-4bc2-813d-6f4dac0df539 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d26ae38d-0e73-4bc2-813d-6f4dac0df539 tempest-CreateVolumesFromSnapshotTest-337369598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d26ae38d-0e73-4bc2-813d-6f4dac0df539 tempest-CreateVolumesFromSnapshotTest-337369598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d26ae38d-0e73-4bc2-813d-6f4dac0df539 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d26ae38d-0e73-4bc2-813d-6f4dac0df539 tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:43 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:50:43 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:43 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ac6a4a4e-7207-44d3-a267-75ee50ab3256 1073741824" returned: 0 in 0.507s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:43 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d26ae38d-0e73-4bc2-813d-6f4dac0df539 tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.275s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:43 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-d26ae38d-0e73-4bc2-813d-6f4dac0df539 tempest-CreateVolumesFromSnapshotTest-337369598 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:50:43 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-d26ae38d-0e73-4bc2-813d-6f4dac0df539 tempest-CreateVolumesFromSnapshotTest-337369598 None] Deleted volume successfully. Nov 02 15:50:43 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d26ae38d-0e73-4bc2-813d-6f4dac0df539 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "cinder-3767bd6a-0ff7-4583-9392-3a6e5bf912fb-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ac6a4a4e-7207-44d3-a267-75ee50ab3256 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:43 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ac6a4a4e-7207-44d3-a267-75ee50ab3256 Nov 02 15:50:43 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-1276870e-9c68-44b9-8fb1-0c3b72028d4e tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "cinder-f61aa4ac-d4dd-47ae-baad-62f7501baa6f-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:43 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:44 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-1276870e-9c68-44b9-8fb1-0c3b72028d4e tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "cinder-f61aa4ac-d4dd-47ae-baad-62f7501baa6f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:44 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-1276870e-9c68-44b9-8fb1-0c3b72028d4e tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "cinder-quobyte-f61aa4ac-d4dd-47ae-baad-62f7501baa6f" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:44 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-1276870e-9c68-44b9-8fb1-0c3b72028d4e tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "cinder-quobyte-f61aa4ac-d4dd-47ae-baad-62f7501baa6f" acquired by "delete_volume" :: waited 0.025s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:44 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f0c916-ab3b-4b6a-89a6-d49fd582f42d]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1276870e-9c68-44b9-8fb1-0c3b72028d4e tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f61aa4ac-d4dd-47ae-baad-62f7501baa6f {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:44 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3a6feb5f-cd5d-4f27-8526-97393ca9ee8a tempest-ProjectReaderTests-665207650 None] Acquiring lock "cinder-41b31b58-24c0-458e-95a6-8eaa3e2c5c00-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:44 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3a6feb5f-cd5d-4f27-8526-97393ca9ee8a tempest-ProjectReaderTests-665207650 None] Lock "cinder-41b31b58-24c0-458e-95a6-8eaa3e2c5c00-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:44 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3a6feb5f-cd5d-4f27-8526-97393ca9ee8a tempest-ProjectReaderTests-665207650 None] Acquiring lock "cinder-quobyte-a8760ef4-0c46-498e-ad8d-d1c405f56fb6" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:44 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3a6feb5f-cd5d-4f27-8526-97393ca9ee8a tempest-ProjectReaderTests-665207650 None] Lock "cinder-quobyte-a8760ef4-0c46-498e-ad8d-d1c405f56fb6" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:44 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3a6feb5f-cd5d-4f27-8526-97393ca9ee8a tempest-ProjectReaderTests-665207650 None] Acquiring lock "cinder-quobyte-41b31b58-24c0-458e-95a6-8eaa3e2c5c00" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:44 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3a6feb5f-cd5d-4f27-8526-97393ca9ee8a tempest-ProjectReaderTests-665207650 None] Lock "cinder-quobyte-41b31b58-24c0-458e-95a6-8eaa3e2c5c00" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:44 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f61aa4ac-d4dd-47ae-baad-62f7501baa6f Nov 02 15:50:44 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:44 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-3a6feb5f-cd5d-4f27-8526-97393ca9ee8a tempest-ProjectReaderTests-665207650 None] Deleting offline snapshot 41b31b58-24c0-458e-95a6-8eaa3e2c5c00 of volume a8760ef4-0c46-498e-ad8d-d1c405f56fb6 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:50:44 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:44 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-3a6feb5f-cd5d-4f27-8526-97393ca9ee8a tempest-ProjectReaderTests-665207650 None] snapshot_file for this snap is: volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6.41b31b58-24c0-458e-95a6-8eaa3e2c5c00 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:50:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ac6a4a4e-7207-44d3-a267-75ee50ab3256" returned: 0 in 0.409s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:44 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:50:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97fbab4d-6621-4deb-9bcd-97440725ae22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac6a4a4e-7207-44d3-a267-75ee50ab3256', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ee2690-31b3-40c9-a490-bf9570c42037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:44 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a05a92-fa69-4e2a-b41d-6e649c3f9b57]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3a6feb5f-cd5d-4f27-8526-97393ca9ee8a tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6.41b31b58-24c0-458e-95a6-8eaa3e2c5c00 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:44 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Volume volume-ac6a4a4e-7207-44d3-a267-75ee50ab3256 (ac6a4a4e-7207-44d3-a267-75ee50ab3256): created successfully Nov 02 15:50:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2ee2690-31b3-40c9-a490-bf9570c42037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:44 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Flow 'volume_create_manager' (0437192a-8fad-46c4-8dae-5ffa93093d31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:44 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-f8ea6e48-69dc-4b89-9e49-7b46fba8276f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Created volume successfully. Nov 02 15:50:44 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6.41b31b58-24c0-458e-95a6-8eaa3e2c5c00 Nov 02 15:50:44 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:44 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1276870e-9c68-44b9-8fb1-0c3b72028d4e tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f61aa4ac-d4dd-47ae-baad-62f7501baa6f" returned: 0 in 0.479s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1276870e-9c68-44b9-8fb1-0c3b72028d4e tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f61aa4ac-d4dd-47ae-baad-62f7501baa6f {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:44 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f61aa4ac-d4dd-47ae-baad-62f7501baa6f Nov 02 15:50:44 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:44 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3a6feb5f-cd5d-4f27-8526-97393ca9ee8a tempest-ProjectReaderTests-665207650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6.41b31b58-24c0-458e-95a6-8eaa3e2c5c00" returned: 0 in 0.469s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:44 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-3a6feb5f-cd5d-4f27-8526-97393ca9ee8a tempest-ProjectReaderTests-665207650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:50:44 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5114ee-1547-4deb-8114-131149f6c1c1]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3a6feb5f-cd5d-4f27-8526-97393ca9ee8a tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:44 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1276870e-9c68-44b9-8fb1-0c3b72028d4e tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f61aa4ac-d4dd-47ae-baad-62f7501baa6f" returned: 0 in 0.289s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:44 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-1276870e-9c68-44b9-8fb1-0c3b72028d4e tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "cinder-quobyte-f61aa4ac-d4dd-47ae-baad-62f7501baa6f" released by "delete_volume" :: held 0.833s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:44 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-1276870e-9c68-44b9-8fb1-0c3b72028d4e tempest-CreateVolumesFromSnapshotTest-337369598 None] Created reservations ['d3d45569-bbb7-4d5a-b1a9-a02632dc4128', '5389e5ac-72bd-4fff-a850-466ade407e01', '02e80686-18a3-44a3-ba5f-79b4108e4430', '732efa8e-3e48-4041-802c-8997c1ce2e47'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:50:45 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6 Nov 02 15:50:45 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1276870e-9c68-44b9-8fb1-0c3b72028d4e tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1276870e-9c68-44b9-8fb1-0c3b72028d4e tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:45 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1276870e-9c68-44b9-8fb1-0c3b72028d4e tempest-CreateVolumesFromSnapshotTest-337369598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:45 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1276870e-9c68-44b9-8fb1-0c3b72028d4e tempest-CreateVolumesFromSnapshotTest-337369598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1276870e-9c68-44b9-8fb1-0c3b72028d4e tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1276870e-9c68-44b9-8fb1-0c3b72028d4e tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:45 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:50:45 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ff2865f5-75a3-4c01-9418-e468ec01a6d7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "cinder-d1179415-ca8b-4d3b-9ce4-b4cbbb266709-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ff2865f5-75a3-4c01-9418-e468ec01a6d7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "cinder-d1179415-ca8b-4d3b-9ce4-b4cbbb266709-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ff2865f5-75a3-4c01-9418-e468ec01a6d7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "cinder-quobyte-0006cebd-3e52-46fb-a72a-04cef236b39c" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ff2865f5-75a3-4c01-9418-e468ec01a6d7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "cinder-quobyte-0006cebd-3e52-46fb-a72a-04cef236b39c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ff2865f5-75a3-4c01-9418-e468ec01a6d7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "cinder-quobyte-d1179415-ca8b-4d3b-9ce4-b4cbbb266709" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ff2865f5-75a3-4c01-9418-e468ec01a6d7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "cinder-quobyte-d1179415-ca8b-4d3b-9ce4-b4cbbb266709" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:45 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-ff2865f5-75a3-4c01-9418-e468ec01a6d7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Deleting offline snapshot d1179415-ca8b-4d3b-9ce4-b4cbbb266709 of volume 0006cebd-3e52-46fb-a72a-04cef236b39c {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:50:45 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-ff2865f5-75a3-4c01-9418-e468ec01a6d7 tempest-CreateVolumesFromSnapshotTest-337369598 None] snapshot_file for this snap is: volume-0006cebd-3e52-46fb-a72a-04cef236b39c.d1179415-ca8b-4d3b-9ce4-b4cbbb266709 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:50:45 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3a6feb5f-cd5d-4f27-8526-97393ca9ee8a tempest-ProjectReaderTests-665207650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6" returned: 0 in 0.445s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3a6feb5f-cd5d-4f27-8526-97393ca9ee8a tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6.41b31b58-24c0-458e-95a6-8eaa3e2c5c00 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:45 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddbcf101-6298-43db-9172-7f9e2e1daba8]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ff2865f5-75a3-4c01-9418-e468ec01a6d7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c.d1179415-ca8b-4d3b-9ce4-b4cbbb266709 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:45 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6.41b31b58-24c0-458e-95a6-8eaa3e2c5c00 Nov 02 15:50:45 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:45 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1276870e-9c68-44b9-8fb1-0c3b72028d4e tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.372s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:45 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-1276870e-9c68-44b9-8fb1-0c3b72028d4e tempest-CreateVolumesFromSnapshotTest-337369598 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:50:45 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-1276870e-9c68-44b9-8fb1-0c3b72028d4e tempest-CreateVolumesFromSnapshotTest-337369598 None] Deleted volume successfully. Nov 02 15:50:45 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c.d1179415-ca8b-4d3b-9ce4-b4cbbb266709 Nov 02 15:50:45 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-1276870e-9c68-44b9-8fb1-0c3b72028d4e tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "cinder-f61aa4ac-d4dd-47ae-baad-62f7501baa6f-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:45 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3a6feb5f-cd5d-4f27-8526-97393ca9ee8a tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6.41b31b58-24c0-458e-95a6-8eaa3e2c5c00" returned: 0 in 0.455s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3a6feb5f-cd5d-4f27-8526-97393ca9ee8a tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6.41b31b58-24c0-458e-95a6-8eaa3e2c5c00 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:45 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6.41b31b58-24c0-458e-95a6-8eaa3e2c5c00 Nov 02 15:50:45 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:45 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ff2865f5-75a3-4c01-9418-e468ec01a6d7 tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c.d1179415-ca8b-4d3b-9ce4-b4cbbb266709" returned: 0 in 0.498s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:45 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-ff2865f5-75a3-4c01-9418-e468ec01a6d7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0006cebd-3e52-46fb-a72a-04cef236b39c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:50:45 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1586e65e-cdbc-459e-b373-d940e165f3c0]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ff2865f5-75a3-4c01-9418-e468ec01a6d7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:46 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c Nov 02 15:50:46 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:46 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3a6feb5f-cd5d-4f27-8526-97393ca9ee8a tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6.41b31b58-24c0-458e-95a6-8eaa3e2c5c00" returned: 0 in 0.315s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3a6feb5f-cd5d-4f27-8526-97393ca9ee8a tempest-ProjectReaderTests-665207650 None] Lock "cinder-quobyte-41b31b58-24c0-458e-95a6-8eaa3e2c5c00" released by "_delete_snapshot" :: held 1.816s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3a6feb5f-cd5d-4f27-8526-97393ca9ee8a tempest-ProjectReaderTests-665207650 None] Lock "cinder-quobyte-a8760ef4-0c46-498e-ad8d-d1c405f56fb6" released by "delete_snapshot" :: held 1.850s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-3a6feb5f-cd5d-4f27-8526-97393ca9ee8a tempest-ProjectReaderTests-665207650 None] Created reservations ['64cc5680-b52b-4323-92b4-da6c34f18c1d', 'c09f2d70-ae71-4643-9600-06440dc994c8', '7d02389b-1320-4f25-aa26-92ac92c31883', '1f1857c5-89d9-42fa-a0d9-c4bd7f497bb5'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:50:46 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ff2865f5-75a3-4c01-9418-e468ec01a6d7 tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c" returned: 0 in 0.430s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ff2865f5-75a3-4c01-9418-e468ec01a6d7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c.d1179415-ca8b-4d3b-9ce4-b4cbbb266709 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:46 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c.d1179415-ca8b-4d3b-9ce4-b4cbbb266709 Nov 02 15:50:46 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Flow 'volume_create_manager' (b929e2b7-6f63-4a3a-8529-1d525325e655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba46758d-f57f-4de7-adc0-010a858b6276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba46758d-f57f-4de7-adc0-010a858b6276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-16380781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64c96f67-829a-45be-a8c6-4f68029cdbf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1ff8a210634e2385bc5d408291ccbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:46Z,use_quota=True,user_id='d7f4888441824e5fa83308a6078c716d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70113302-be37-40d4-9386-da51eac2909f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70113302-be37-40d4-9386-da51eac2909f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2828d9-8e18-4968-8fa2-dbe3045cf01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2828d9-8e18-4968-8fa2-dbe3045cf01b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64c96f67-829a-45be-a8c6-4f68029cdbf3', 'volume_name': 'volume-64c96f67-829a-45be-a8c6-4f68029cdbf3', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f57dbd13-54a6-4851-aff8-69a7dcfa9acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f57dbd13-54a6-4851-aff8-69a7dcfa9acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f17c862c-69af-47eb-9dd8-9a3985cf4c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:46 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Volume 64c96f67-829a-45be-a8c6-4f68029cdbf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64c96f67-829a-45be-a8c6-4f68029cdbf3', 'volume_size': 1} Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-16380781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64c96f67-829a-45be-a8c6-4f68029cdbf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1ff8a210634e2385bc5d408291ccbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:46Z,use_quota=True,user_id='d7f4888441824e5fa83308a6078c716d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Creating volume 64c96f67-829a-45be-a8c6-4f68029cdbf3 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:50:46 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-64c96f67-829a-45be-a8c6-4f68029cdbf3 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ab1bfa18-b36b-4ab8-b38e-c4434f2285a8 tempest-ProjectReaderTests-665207650 None] Acquiring lock "cinder-a8760ef4-0c46-498e-ad8d-d1c405f56fb6-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:46 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-64c96f67-829a-45be-a8c6-4f68029cdbf3 1073741824 Nov 02 15:50:46 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:46 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-3a6feb5f-cd5d-4f27-8526-97393ca9ee8a tempest-ProjectReaderTests-665207650 None] Delete snapshot completed successfully. Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ab1bfa18-b36b-4ab8-b38e-c4434f2285a8 tempest-ProjectReaderTests-665207650 None] Lock "cinder-a8760ef4-0c46-498e-ad8d-d1c405f56fb6-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3a6feb5f-cd5d-4f27-8526-97393ca9ee8a tempest-ProjectReaderTests-665207650 None] Lock "cinder-41b31b58-24c0-458e-95a6-8eaa3e2c5c00-delete_snapshot" released by "delete_snapshot" :: held 2.415s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ab1bfa18-b36b-4ab8-b38e-c4434f2285a8 tempest-ProjectReaderTests-665207650 None] Acquiring lock "cinder-quobyte-a8760ef4-0c46-498e-ad8d-d1c405f56fb6" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ab1bfa18-b36b-4ab8-b38e-c4434f2285a8 tempest-ProjectReaderTests-665207650 None] Lock "cinder-quobyte-a8760ef4-0c46-498e-ad8d-d1c405f56fb6" acquired by "delete_volume" :: waited 0.024s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01730d3-3cf3-4364-815e-def7fe67d6f9]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ab1bfa18-b36b-4ab8-b38e-c4434f2285a8 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:46 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ff2865f5-75a3-4c01-9418-e468ec01a6d7 tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c.d1179415-ca8b-4d3b-9ce4-b4cbbb266709" returned: 0 in 0.666s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ff2865f5-75a3-4c01-9418-e468ec01a6d7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c.d1179415-ca8b-4d3b-9ce4-b4cbbb266709 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:47 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c.d1179415-ca8b-4d3b-9ce4-b4cbbb266709 Nov 02 15:50:47 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:47 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6 Nov 02 15:50:47 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:47 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-64c96f67-829a-45be-a8c6-4f68029cdbf3 1073741824" returned: 0 in 0.744s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:47 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ff2865f5-75a3-4c01-9418-e468ec01a6d7 tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c.d1179415-ca8b-4d3b-9ce4-b4cbbb266709" returned: 0 in 0.344s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-64c96f67-829a-45be-a8c6-4f68029cdbf3 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:47 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ff2865f5-75a3-4c01-9418-e468ec01a6d7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "cinder-quobyte-d1179415-ca8b-4d3b-9ce4-b4cbbb266709" released by "_delete_snapshot" :: held 2.149s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:47 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-64c96f67-829a-45be-a8c6-4f68029cdbf3 Nov 02 15:50:47 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ff2865f5-75a3-4c01-9418-e468ec01a6d7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "cinder-quobyte-0006cebd-3e52-46fb-a72a-04cef236b39c" released by "delete_snapshot" :: held 2.199s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ab1bfa18-b36b-4ab8-b38e-c4434f2285a8 tempest-ProjectReaderTests-665207650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6" returned: 0 in 0.601s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ab1bfa18-b36b-4ab8-b38e-c4434f2285a8 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:47 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6 Nov 02 15:50:47 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Flow 'volume_create_manager' (990d8606-c5b9-4938-91f7-4f0993de7007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9b97f9d-4de7-446c-811d-6c7c9df44b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Flow 'volume_create_manager' (be05ffc5-5b7e-414a-8b64-0bcd23d8a234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (703202f5-7139-45a9-8233-3d3b8fea668a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9b97f9d-4de7-446c-811d-6c7c9df44b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1206720297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4bf5054-b2fc-4a8b-a138-17bf08aa98d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1ff8a210634e2385bc5d408291ccbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:47Z,use_quota=True,user_id='d7f4888441824e5fa83308a6078c716d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd3abf83-52fc-43a3-9ded-8b6214bbf9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd3abf83-52fc-43a3-9ded-8b6214bbf9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a8bd14-4bc3-4efb-946f-511d793c0763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2a8bd14-4bc3-4efb-946f-511d793c0763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4bf5054-b2fc-4a8b-a138-17bf08aa98d9', 'volume_name': 'volume-b4bf5054-b2fc-4a8b-a138-17bf08aa98d9', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ce3e5c-446d-4ab6-9485-23677da3b840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19ce3e5c-446d-4ab6-9485-23677da3b840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d451efc-3745-4930-8e69-8e4b325449f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:47 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Volume b4bf5054-b2fc-4a8b-a138-17bf08aa98d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4bf5054-b2fc-4a8b-a138-17bf08aa98d9', 'volume_size': 1} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (703202f5-7139-45a9-8233-3d3b8fea668a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-128436219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c14a04ac-9d3f-4473-b42e-e3d8264a8163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1ff8a210634e2385bc5d408291ccbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:47Z,use_quota=True,user_id='d7f4888441824e5fa83308a6078c716d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:47 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dddde47f-3a6f-483c-8ccb-dbc86d4691bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dddde47f-3a6f-483c-8ccb-dbc86d4691bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea692f7-a981-42c7-8a81-11237d8199e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dea692f7-a981-42c7-8a81-11237d8199e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c14a04ac-9d3f-4473-b42e-e3d8264a8163', 'volume_name': 'volume-c14a04ac-9d3f-4473-b42e-e3d8264a8163', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3139b1e-736d-454c-acbe-c11265070395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3139b1e-736d-454c-acbe-c11265070395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6922df65-3efc-49a3-af97-51bf5a56d887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:47 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Volume c14a04ac-9d3f-4473-b42e-e3d8264a8163: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c14a04ac-9d3f-4473-b42e-e3d8264a8163', 'volume_size': 1} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-64c96f67-829a-45be-a8c6-4f68029cdbf3" returned: 0 in 0.394s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.083s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1206720297',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4bf5054-b2fc-4a8b-a138-17bf08aa98d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1ff8a210634e2385bc5d408291ccbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:47Z,use_quota=True,user_id='d7f4888441824e5fa83308a6078c716d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Creating volume b4bf5054-b2fc-4a8b-a138-17bf08aa98d9 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:50:47 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b4bf5054-b2fc-4a8b-a138-17bf08aa98d9 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:47 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b4bf5054-b2fc-4a8b-a138-17bf08aa98d9 1073741824 Nov 02 15:50:47 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:47 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ab1bfa18-b36b-4ab8-b38e-c4434f2285a8 tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-a8760ef4-0c46-498e-ad8d-d1c405f56fb6" returned: 0 in 0.424s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:47 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ab1bfa18-b36b-4ab8-b38e-c4434f2285a8 tempest-ProjectReaderTests-665207650 None] Lock "cinder-quobyte-a8760ef4-0c46-498e-ad8d-d1c405f56fb6" released by "delete_volume" :: held 1.134s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-ff2865f5-75a3-4c01-9418-e468ec01a6d7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Created reservations ['93b802d1-4e08-4dc9-94ee-7fa8c65f2435', 'c8e210b9-f9e3-4d6a-8af6-f9598bc495e5', '3af51647-235a-40c6-87a0-fbfee15238bb', 'bfdf945a-b8ae-4190-bade-de3d50794fb4'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f17c862c-69af-47eb-9dd8-9a3985cf4c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64c96f67-829a-45be-a8c6-4f68029cdbf3', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3f7264-bfab-4c8f-974a-9fab0ce72eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-ab1bfa18-b36b-4ab8-b38e-c4434f2285a8 tempest-ProjectReaderTests-665207650 None] Created reservations ['4695e99c-97b6-41ea-9382-a5cc63a0f7f7', 'f348345c-20d7-4f1f-9390-0f5713fec24b', '984e5aa5-c248-4bda-aeba-b986abbec80e', '74fc9d67-bb94-4c0d-b6bd-f7fac6a2a1ee'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:50:48 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Volume volume-64c96f67-829a-45be-a8c6-4f68029cdbf3 (64c96f67-829a-45be-a8c6-4f68029cdbf3): created successfully Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3f7264-bfab-4c8f-974a-9fab0ce72eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Flow 'volume_create_manager' (b929e2b7-6f63-4a3a-8529-1d525325e655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:48 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-19272b2f-a099-4476-b8cb-3e4c75efb25f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Created volume successfully. Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Flow 'volume_create_manager' (46a3db9d-a4a1-4eaf-bad5-a14d80e22f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4563d1-80e0-4684-8926-c8d8708832af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4563d1-80e0-4684-8926-c8d8708832af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1714935145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23d8b630-6224-43bc-99f9-f8d3dc89c292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1ff8a210634e2385bc5d408291ccbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:48Z,use_quota=True,user_id='d7f4888441824e5fa83308a6078c716d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4b7684-6246-48bb-9a36-e80e89cd8b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f4b7684-6246-48bb-9a36-e80e89cd8b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ff7a3d6-0d6b-46f8-90ad-37ca183d5132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ff7a3d6-0d6b-46f8-90ad-37ca183d5132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23d8b630-6224-43bc-99f9-f8d3dc89c292', 'volume_name': 'volume-23d8b630-6224-43bc-99f9-f8d3dc89c292', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ed4b64-6831-47e3-af8a-03b51b107b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50ed4b64-6831-47e3-af8a-03b51b107b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea5522a5-838c-4bf5-8a68-00c66eb4eeb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:48 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Volume 23d8b630-6224-43bc-99f9-f8d3dc89c292: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23d8b630-6224-43bc-99f9-f8d3dc89c292', 'volume_size': 1} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:48 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-ff2865f5-75a3-4c01-9418-e468ec01a6d7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Delete snapshot completed successfully. Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ff2865f5-75a3-4c01-9418-e468ec01a6d7 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "cinder-d1179415-ca8b-4d3b-9ce4-b4cbbb266709-delete_snapshot" released by "delete_snapshot" :: held 3.175s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ab1bfa18-b36b-4ab8-b38e-c4434f2285a8 tempest-ProjectReaderTests-665207650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ab1bfa18-b36b-4ab8-b38e-c4434f2285a8 tempest-ProjectReaderTests-665207650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ab1bfa18-b36b-4ab8-b38e-c4434f2285a8 tempest-ProjectReaderTests-665207650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ab1bfa18-b36b-4ab8-b38e-c4434f2285a8 tempest-ProjectReaderTests-665207650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ab1bfa18-b36b-4ab8-b38e-c4434f2285a8 tempest-ProjectReaderTests-665207650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ab1bfa18-b36b-4ab8-b38e-c4434f2285a8 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:48 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b4bf5054-b2fc-4a8b-a138-17bf08aa98d9 1073741824" returned: 0 in 0.619s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:48 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:50:48 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b4bf5054-b2fc-4a8b-a138-17bf08aa98d9 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:48 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b4bf5054-b2fc-4a8b-a138-17bf08aa98d9 Nov 02 15:50:48 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Flow 'volume_create_manager' (b8f27c19-4a90-4cf7-9183-f1a0ed5706cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b83dd3f-ebec-4be6-ac0f-7b59c3e44111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ecb16b10-c0c0-4368-a984-28db5da61ba5 tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "cinder-0006cebd-3e52-46fb-a72a-04cef236b39c-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b83dd3f-ebec-4be6-ac0f-7b59c3e44111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1700654560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64306a00-6614-41ea-a27b-4f61e5ce62ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1ff8a210634e2385bc5d408291ccbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:48Z,use_quota=True,user_id='d7f4888441824e5fa83308a6078c716d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c42cc26-261a-47bf-9024-c356efa5306d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c42cc26-261a-47bf-9024-c356efa5306d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a8cfe1d-3e32-4c15-859a-ed8c19608651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a8cfe1d-3e32-4c15-859a-ed8c19608651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64306a00-6614-41ea-a27b-4f61e5ce62ff', 'volume_name': 'volume-64306a00-6614-41ea-a27b-4f61e5ce62ff', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (306752b1-1815-4f1b-9f0f-f4f044a3845a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (306752b1-1815-4f1b-9f0f-f4f044a3845a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9761845-12be-4ce1-bbf0-09ee7797c296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:48 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Volume 64306a00-6614-41ea-a27b-4f61e5ce62ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64306a00-6614-41ea-a27b-4f61e5ce62ff', 'volume_size': 1} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:48 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ecb16b10-c0c0-4368-a984-28db5da61ba5 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "cinder-0006cebd-3e52-46fb-a72a-04cef236b39c-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ab1bfa18-b36b-4ab8-b38e-c4434f2285a8 tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.346s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-ab1bfa18-b36b-4ab8-b38e-c4434f2285a8 tempest-ProjectReaderTests-665207650 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:50:48 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-ab1bfa18-b36b-4ab8-b38e-c4434f2285a8 tempest-ProjectReaderTests-665207650 None] Deleted volume successfully. Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ecb16b10-c0c0-4368-a984-28db5da61ba5 tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "cinder-quobyte-0006cebd-3e52-46fb-a72a-04cef236b39c" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ab1bfa18-b36b-4ab8-b38e-c4434f2285a8 tempest-ProjectReaderTests-665207650 None] Lock "cinder-a8760ef4-0c46-498e-ad8d-d1c405f56fb6-delete_volume" released by "delete_volume" :: held 2.139s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ecb16b10-c0c0-4368-a984-28db5da61ba5 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "cinder-quobyte-0006cebd-3e52-46fb-a72a-04cef236b39c" acquired by "delete_volume" :: waited 0.021s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a86156f-74be-4b4d-b5b9-a34bb4fcf56b]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ecb16b10-c0c0-4368-a984-28db5da61ba5 tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:48 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b4bf5054-b2fc-4a8b-a138-17bf08aa98d9" returned: 0 in 0.474s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] <== create_volume: return (1150ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.154s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.168s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-128436219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c14a04ac-9d3f-4473-b42e-e3d8264a8163,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1ff8a210634e2385bc5d408291ccbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:47Z,use_quota=True,user_id='d7f4888441824e5fa83308a6078c716d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Creating volume c14a04ac-9d3f-4473-b42e-e3d8264a8163 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:50:48 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:50:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c14a04ac-9d3f-4473-b42e-e3d8264a8163 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:49 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c14a04ac-9d3f-4473-b42e-e3d8264a8163 1073741824 Nov 02 15:50:49 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d451efc-3745-4930-8e69-8e4b325449f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4bf5054-b2fc-4a8b-a138-17bf08aa98d9', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6060428f-6f17-4f99-997f-1764ff13893f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:49 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Volume volume-b4bf5054-b2fc-4a8b-a138-17bf08aa98d9 (b4bf5054-b2fc-4a8b-a138-17bf08aa98d9): created successfully Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6060428f-6f17-4f99-997f-1764ff13893f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Flow 'volume_create_manager' (990d8606-c5b9-4938-91f7-4f0993de7007) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:49 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-8e3e76bc-299c-447d-ac00-0d09e1e81c8f tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Created volume successfully. Nov 02 15:50:49 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c Nov 02 15:50:49 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:49 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ecb16b10-c0c0-4368-a984-28db5da61ba5 tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c" returned: 0 in 0.453s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ecb16b10-c0c0-4368-a984-28db5da61ba5 tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:49 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c Nov 02 15:50:49 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:49 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c14a04ac-9d3f-4473-b42e-e3d8264a8163 1073741824" returned: 0 in 0.530s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c14a04ac-9d3f-4473-b42e-e3d8264a8163 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:49 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c14a04ac-9d3f-4473-b42e-e3d8264a8163 Nov 02 15:50:49 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] Flow 'volume_create_manager' (2e5e83b7-687e-4c2f-b4d0-8caaf04ea941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c42ea4b-664b-45fd-aa30-9244876b87bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c42ea4b-664b-45fd-aa30-9244876b87bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1488752861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c6032d2-c94c-4427-9515-be69537a294d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081ecbd5e3694d9d9779db39943c12e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:50Z,use_quota=True,user_id='c8c5dd94e82a45439e6816d23423ecdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:49 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89aa0f7f-ada9-4fe4-bb07-2d6068d0383f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89aa0f7f-ada9-4fe4-bb07-2d6068d0383f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (110f31e1-5681-476d-b35f-d4ecda10abde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (110f31e1-5681-476d-b35f-d4ecda10abde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c6032d2-c94c-4427-9515-be69537a294d', 'volume_name': 'volume-9c6032d2-c94c-4427-9515-be69537a294d', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d5fd8a-52a2-4846-b796-8ec9f5056cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d5fd8a-52a2-4846-b796-8ec9f5056cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a513c033-5d06-4bf0-a335-126e6531345a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:49 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] Volume 9c6032d2-c94c-4427-9515-be69537a294d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c6032d2-c94c-4427-9515-be69537a294d', 'volume_size': 1} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ecb16b10-c0c0-4368-a984-28db5da61ba5 tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-0006cebd-3e52-46fb-a72a-04cef236b39c" returned: 0 in 0.331s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ecb16b10-c0c0-4368-a984-28db5da61ba5 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "cinder-quobyte-0006cebd-3e52-46fb-a72a-04cef236b39c" released by "delete_volume" :: held 0.918s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-ecb16b10-c0c0-4368-a984-28db5da61ba5 tempest-CreateVolumesFromSnapshotTest-337369598 None] Created reservations ['c14ce0b4-27f7-443c-a7ee-a4f29ea00a12', '3b2c6973-0308-43d4-b6c2-2d2ad6a3d7ff', '5db314d5-3ed6-402f-806b-45059305e187', '7b1aed39-5677-4e13-b17a-1c448431a844'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:50:49 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c14a04ac-9d3f-4473-b42e-e3d8264a8163" returned: 0 in 0.261s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.455s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1714935145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23d8b630-6224-43bc-99f9-f8d3dc89c292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1ff8a210634e2385bc5d408291ccbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:48Z,use_quota=True,user_id='d7f4888441824e5fa83308a6078c716d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Creating volume 23d8b630-6224-43bc-99f9-f8d3dc89c292 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:50:49 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-23d8b630-6224-43bc-99f9-f8d3dc89c292 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:49 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-23d8b630-6224-43bc-99f9-f8d3dc89c292 1073741824 Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6922df65-3efc-49a3-af97-51bf5a56d887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c14a04ac-9d3f-4473-b42e-e3d8264a8163', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:49 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (679679a0-9e61-4893-8139-33a8a6a73cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ecb16b10-c0c0-4368-a984-28db5da61ba5 tempest-CreateVolumesFromSnapshotTest-337369598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ecb16b10-c0c0-4368-a984-28db5da61ba5 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ecb16b10-c0c0-4368-a984-28db5da61ba5 tempest-CreateVolumesFromSnapshotTest-337369598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ecb16b10-c0c0-4368-a984-28db5da61ba5 tempest-CreateVolumesFromSnapshotTest-337369598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ecb16b10-c0c0-4368-a984-28db5da61ba5 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ecb16b10-c0c0-4368-a984-28db5da61ba5 tempest-CreateVolumesFromSnapshotTest-337369598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:49 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Volume volume-c14a04ac-9d3f-4473-b42e-e3d8264a8163 (c14a04ac-9d3f-4473-b42e-e3d8264a8163): created successfully Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (679679a0-9e61-4893-8139-33a8a6a73cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:49 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:50:49 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:49 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Flow 'volume_create_manager' (be05ffc5-5b7e-414a-8b64-0bcd23d8a234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:49 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-ba114d0b-03e5-4e2e-bf53-76c1841de6c5 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Created volume successfully. Nov 02 15:50:50 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ecb16b10-c0c0-4368-a984-28db5da61ba5 tempest-CreateVolumesFromSnapshotTest-337369598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.265s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:50 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-ecb16b10-c0c0-4368-a984-28db5da61ba5 tempest-CreateVolumesFromSnapshotTest-337369598 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:50:50 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-ecb16b10-c0c0-4368-a984-28db5da61ba5 tempest-CreateVolumesFromSnapshotTest-337369598 None] Deleted volume successfully. Nov 02 15:50:50 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ecb16b10-c0c0-4368-a984-28db5da61ba5 tempest-CreateVolumesFromSnapshotTest-337369598 None] Lock "cinder-0006cebd-3e52-46fb-a72a-04cef236b39c-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:50 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-23d8b630-6224-43bc-99f9-f8d3dc89c292 1073741824" returned: 0 in 0.495s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-23d8b630-6224-43bc-99f9-f8d3dc89c292 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:50 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-23d8b630-6224-43bc-99f9-f8d3dc89c292 Nov 02 15:50:50 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:50 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-23d8b630-6224-43bc-99f9-f8d3dc89c292" returned: 0 in 0.270s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:50 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:50:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.918s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:50 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1700654560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64306a00-6614-41ea-a27b-4f61e5ce62ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1ff8a210634e2385bc5d408291ccbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:48Z,use_quota=True,user_id='d7f4888441824e5fa83308a6078c716d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:50:50 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Creating volume 64306a00-6614-41ea-a27b-4f61e5ce62ff {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:50:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:50 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:50 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:50 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:50:50 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:50:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-64306a00-6614-41ea-a27b-4f61e5ce62ff 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:50 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-64306a00-6614-41ea-a27b-4f61e5ce62ff 1073741824 Nov 02 15:50:50 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea5522a5-838c-4bf5-8a68-00c66eb4eeb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23d8b630-6224-43bc-99f9-f8d3dc89c292', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edaaa1b3-3b22-4836-9e2f-dc1923084491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:50 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Volume volume-23d8b630-6224-43bc-99f9-f8d3dc89c292 (23d8b630-6224-43bc-99f9-f8d3dc89c292): created successfully Nov 02 15:50:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edaaa1b3-3b22-4836-9e2f-dc1923084491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Flow 'volume_create_manager' (46a3db9d-a4a1-4eaf-bad5-a14d80e22f2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:50 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-7d23af8e-8173-4555-a6be-bd5f8deee959 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Created volume successfully. Nov 02 15:50:51 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-64306a00-6614-41ea-a27b-4f61e5ce62ff 1073741824" returned: 0 in 0.514s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-64306a00-6614-41ea-a27b-4f61e5ce62ff {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:51 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-64306a00-6614-41ea-a27b-4f61e5ce62ff Nov 02 15:50:51 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:51 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-64306a00-6614-41ea-a27b-4f61e5ce62ff" returned: 0 in 0.248s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:51 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:50:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.747s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:51 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1488752861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c6032d2-c94c-4427-9515-be69537a294d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081ecbd5e3694d9d9779db39943c12e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:50Z,use_quota=True,user_id='c8c5dd94e82a45439e6816d23423ecdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:50:51 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] Creating volume 9c6032d2-c94c-4427-9515-be69537a294d {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:50:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:51 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:51 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:51 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:50:51 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:50:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:51 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9761845-12be-4ce1-bbf0-09ee7797c296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64306a00-6614-41ea-a27b-4f61e5ce62ff', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:51 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d 1073741824 Nov 02 15:50:51 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:51 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfef58b6-e36b-4317-bd53-7ede6fb348e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:51 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Volume volume-64306a00-6614-41ea-a27b-4f61e5ce62ff (64306a00-6614-41ea-a27b-4f61e5ce62ff): created successfully Nov 02 15:50:51 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfef58b6-e36b-4317-bd53-7ede6fb348e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:51 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Flow 'volume_create_manager' (b8f27c19-4a90-4cf7-9183-f1a0ed5706cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:51 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-ac081188-56b3-44d5-b504-d7b74ae2d41c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Created volume successfully. Nov 02 15:50:51 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-88e372c9-5861-46da-83a5-9a7e1994a65c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Acquiring lock "cinder-64306a00-6614-41ea-a27b-4f61e5ce62ff-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:51 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-88e372c9-5861-46da-83a5-9a7e1994a65c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "cinder-64306a00-6614-41ea-a27b-4f61e5ce62ff-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:51 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-88e372c9-5861-46da-83a5-9a7e1994a65c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Acquiring lock "cinder-quobyte-64306a00-6614-41ea-a27b-4f61e5ce62ff" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:51 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-88e372c9-5861-46da-83a5-9a7e1994a65c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "cinder-quobyte-64306a00-6614-41ea-a27b-4f61e5ce62ff" acquired by "delete_volume" :: waited 0.019s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:52 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfacbd6f-0344-4f1d-9309-0c046eaa019d]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-88e372c9-5861-46da-83a5-9a7e1994a65c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-64306a00-6614-41ea-a27b-4f61e5ce62ff {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:52 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d 1073741824" returned: 0 in 0.555s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:52 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d Nov 02 15:50:52 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:52 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-64306a00-6614-41ea-a27b-4f61e5ce62ff Nov 02 15:50:52 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d" returned: 0 in 0.307s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:52 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:52 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:50:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:52 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a513c033-5d06-4bf0-a335-126e6531345a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c6032d2-c94c-4427-9515-be69537a294d', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:52 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2559b85b-41ae-4ccc-8ca3-aaf2d61c92a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:52 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] Volume volume-9c6032d2-c94c-4427-9515-be69537a294d (9c6032d2-c94c-4427-9515-be69537a294d): created successfully Nov 02 15:50:52 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2559b85b-41ae-4ccc-8ca3-aaf2d61c92a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:52 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] Flow 'volume_create_manager' (2e5e83b7-687e-4c2f-b4d0-8caaf04ea941) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:52 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-236be0f2-b337-4c0f-b7c4-73408abc4f2d tempest-ProjectReaderTests-665207650 None] Created volume successfully. Nov 02 15:50:52 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-88e372c9-5861-46da-83a5-9a7e1994a65c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-64306a00-6614-41ea-a27b-4f61e5ce62ff" returned: 0 in 0.482s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-88e372c9-5861-46da-83a5-9a7e1994a65c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-64306a00-6614-41ea-a27b-4f61e5ce62ff {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:52 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-64306a00-6614-41ea-a27b-4f61e5ce62ff Nov 02 15:50:52 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:52 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-88e372c9-5861-46da-83a5-9a7e1994a65c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-64306a00-6614-41ea-a27b-4f61e5ce62ff" returned: 0 in 0.283s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:52 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-88e372c9-5861-46da-83a5-9a7e1994a65c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "cinder-quobyte-64306a00-6614-41ea-a27b-4f61e5ce62ff" released by "delete_volume" :: held 0.819s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:52 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-88e372c9-5861-46da-83a5-9a7e1994a65c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Created reservations ['0e2bd620-51d8-4218-800b-e236ce8562fb', 'caca16c6-8851-4f88-bc3f-a1af1374d58d', 'd74facd7-ee7f-42af-b2af-e674c4204616', 'e71a3f4e-94f5-4d04-8d13-7782f4edf74d'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:50:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-88e372c9-5861-46da-83a5-9a7e1994a65c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-88e372c9-5861-46da-83a5-9a7e1994a65c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:53 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-88e372c9-5861-46da-83a5-9a7e1994a65c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:53 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-88e372c9-5861-46da-83a5-9a7e1994a65c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-88e372c9-5861-46da-83a5-9a7e1994a65c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-88e372c9-5861-46da-83a5-9a7e1994a65c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:53 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:50:53 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:53 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b3d4efde-8315-44cd-a883-069c4456ee2c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Acquiring lock "cinder-23d8b630-6224-43bc-99f9-f8d3dc89c292-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:53 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b3d4efde-8315-44cd-a883-069c4456ee2c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "cinder-23d8b630-6224-43bc-99f9-f8d3dc89c292-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0fac755d-5f3b-4313-b021-d6079540079b tempest-ProjectReaderTests-665207650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0fac755d-5f3b-4313-b021-d6079540079b tempest-ProjectReaderTests-665207650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:53 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-0fac755d-5f3b-4313-b021-d6079540079b tempest-ProjectReaderTests-665207650 None] Creating offline snapshot 7f166ee9-2036-43c7-a1ae-0ce9199a4597 of volume 9c6032d2-c94c-4427-9515-be69537a294d {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:50:53 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b3d4efde-8315-44cd-a883-069c4456ee2c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Acquiring lock "cinder-quobyte-23d8b630-6224-43bc-99f9-f8d3dc89c292" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:53 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6612d5-ffac-4bd8-a742-2d5937ef96bc]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0fac755d-5f3b-4313-b021-d6079540079b tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:53 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b3d4efde-8315-44cd-a883-069c4456ee2c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "cinder-quobyte-23d8b630-6224-43bc-99f9-f8d3dc89c292" acquired by "delete_volume" :: waited 0.042s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:53 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[89fa241b-4ed5-48b3-9b9e-3ce19e3fa58d]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b3d4efde-8315-44cd-a883-069c4456ee2c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-23d8b630-6224-43bc-99f9-f8d3dc89c292 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:53 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-88e372c9-5861-46da-83a5-9a7e1994a65c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.378s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:53 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-88e372c9-5861-46da-83a5-9a7e1994a65c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:50:53 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d Nov 02 15:50:53 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-88e372c9-5861-46da-83a5-9a7e1994a65c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Deleted volume successfully. Nov 02 15:50:53 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:53 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-88e372c9-5861-46da-83a5-9a7e1994a65c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "cinder-64306a00-6614-41ea-a27b-4f61e5ce62ff-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:53 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-23d8b630-6224-43bc-99f9-f8d3dc89c292 Nov 02 15:50:53 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:53 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0fac755d-5f3b-4313-b021-d6079540079b tempest-ProjectReaderTests-665207650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d" returned: 0 in 0.495s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0fac755d-5f3b-4313-b021-d6079540079b tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d.7f166ee9-2036-43c7-a1ae-0ce9199a4597 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:53 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d.7f166ee9-2036-43c7-a1ae-0ce9199a4597 1G Nov 02 15:50:53 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:53 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b3d4efde-8315-44cd-a883-069c4456ee2c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-23d8b630-6224-43bc-99f9-f8d3dc89c292" returned: 0 in 0.485s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b3d4efde-8315-44cd-a883-069c4456ee2c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-23d8b630-6224-43bc-99f9-f8d3dc89c292 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:53 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-23d8b630-6224-43bc-99f9-f8d3dc89c292 Nov 02 15:50:53 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:54 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b3d4efde-8315-44cd-a883-069c4456ee2c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-23d8b630-6224-43bc-99f9-f8d3dc89c292" returned: 0 in 0.325s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:54 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b3d4efde-8315-44cd-a883-069c4456ee2c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "cinder-quobyte-23d8b630-6224-43bc-99f9-f8d3dc89c292" released by "delete_volume" :: held 0.898s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:54 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-b3d4efde-8315-44cd-a883-069c4456ee2c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Created reservations ['995e73c8-90b5-4610-83f9-4eb000ce7f3c', 'f74a4482-ab8f-41af-a756-be352c04a8e5', 'c5824662-8de3-4fb2-b815-f6f86bef7dcf', '755bc871-98a2-43d8-af23-32cd1582163f'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:50:54 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0fac755d-5f3b-4313-b021-d6079540079b tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d.7f166ee9-2036-43c7-a1ae-0ce9199a4597 1G" returned: 0 in 0.578s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0fac755d-5f3b-4313-b021-d6079540079b tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c6032d2-c94c-4427-9515-be69537a294d -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d.7f166ee9-2036-43c7-a1ae-0ce9199a4597 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:54 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c6032d2-c94c-4427-9515-be69537a294d -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d.7f166ee9-2036-43c7-a1ae-0ce9199a4597 Nov 02 15:50:54 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b3d4efde-8315-44cd-a883-069c4456ee2c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b3d4efde-8315-44cd-a883-069c4456ee2c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:54 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b3d4efde-8315-44cd-a883-069c4456ee2c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:54 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b3d4efde-8315-44cd-a883-069c4456ee2c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b3d4efde-8315-44cd-a883-069c4456ee2c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b3d4efde-8315-44cd-a883-069c4456ee2c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:54 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:50:54 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:54 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:54 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b3d4efde-8315-44cd-a883-069c4456ee2c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.417s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0fac755d-5f3b-4313-b021-d6079540079b tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c6032d2-c94c-4427-9515-be69537a294d -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d.7f166ee9-2036-43c7-a1ae-0ce9199a4597" returned: 0 in 0.474s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:54 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-b3d4efde-8315-44cd-a883-069c4456ee2c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:50:54 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-0fac755d-5f3b-4313-b021-d6079540079b tempest-ProjectReaderTests-665207650 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d.7f166ee9-2036-43c7-a1ae-0ce9199a4597 is being set with open permissions: ugo+rw Nov 02 15:50:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0fac755d-5f3b-4313-b021-d6079540079b tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d.7f166ee9-2036-43c7-a1ae-0ce9199a4597 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:54 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-b3d4efde-8315-44cd-a883-069c4456ee2c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Deleted volume successfully. Nov 02 15:50:54 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d.7f166ee9-2036-43c7-a1ae-0ce9199a4597 Nov 02 15:50:54 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:54 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:50:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] Flow 'volume_create_manager' (c509b86f-584f-4773-837a-024715702525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ad6044-3ed7-4a15-99a1-2b3e6a3d748b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:54 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b3d4efde-8315-44cd-a883-069c4456ee2c tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "cinder-23d8b630-6224-43bc-99f9-f8d3dc89c292-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50ad6044-3ed7-4a15-99a1-2b3e6a3d748b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-499537927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6264e590-3010-4d9e-a4c2-23cb492e1f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0fd8a3c0736467e9e7a8864c99b9567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:55Z,use_quota=True,user_id='3dc6457663604ddba690c430bca88a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed23548-7b6c-4a6f-bce4-4df1086be567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed23548-7b6c-4a6f-bce4-4df1086be567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (246188d6-be17-415b-8b12-14a1e5c20cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (246188d6-be17-415b-8b12-14a1e5c20cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6264e590-3010-4d9e-a4c2-23cb492e1f5f', 'volume_name': 'volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4332d271-5410-4f16-9abb-fe69c0c6f307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4332d271-5410-4f16-9abb-fe69c0c6f307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e228903-2b4e-4141-96be-43db5fe04c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:54 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] Volume 6264e590-3010-4d9e-a4c2-23cb492e1f5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f', 'volume_size': 1} Nov 02 15:50:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:55 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0fac755d-5f3b-4313-b021-d6079540079b tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d.7f166ee9-2036-43c7-a1ae-0ce9199a4597" returned: 0 in 0.269s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0fac755d-5f3b-4313-b021-d6079540079b tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:55 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d.info Nov 02 15:50:55 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:55 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0fac755d-5f3b-4313-b021-d6079540079b tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d.info" returned: 0 in 0.295s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:55 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-0fac755d-5f3b-4313-b021-d6079540079b tempest-ProjectReaderTests-665207650 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d.info is being set with open permissions: ugo+rw Nov 02 15:50:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0fac755d-5f3b-4313-b021-d6079540079b tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:55 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b1982cba-375e-4c08-a439-710068541ef9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Acquiring lock "cinder-c14a04ac-9d3f-4473-b42e-e3d8264a8163-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:55 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d.info Nov 02 15:50:55 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:55 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b1982cba-375e-4c08-a439-710068541ef9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "cinder-c14a04ac-9d3f-4473-b42e-e3d8264a8163-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:55 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b1982cba-375e-4c08-a439-710068541ef9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Acquiring lock "cinder-quobyte-c14a04ac-9d3f-4473-b42e-e3d8264a8163" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:55 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b1982cba-375e-4c08-a439-710068541ef9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "cinder-quobyte-c14a04ac-9d3f-4473-b42e-e3d8264a8163" acquired by "delete_volume" :: waited 0.017s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:55 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[54445d57-366d-4c56-8d8b-b82291096373]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b1982cba-375e-4c08-a439-710068541ef9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c14a04ac-9d3f-4473-b42e-e3d8264a8163 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:55 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c14a04ac-9d3f-4473-b42e-e3d8264a8163 Nov 02 15:50:55 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:55 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0fac755d-5f3b-4313-b021-d6079540079b tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d.info" returned: 0 in 0.293s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0fac755d-5f3b-4313-b021-d6079540079b tempest-ProjectReaderTests-665207650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.555s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.807s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:55 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-499537927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6264e590-3010-4d9e-a4c2-23cb492e1f5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0fd8a3c0736467e9e7a8864c99b9567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:50:55Z,use_quota=True,user_id='3dc6457663604ddba690c430bca88a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:50:55 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] Creating volume 6264e590-3010-4d9e-a4c2-23cb492e1f5f {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:50:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:55 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:55 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:55 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:50:55 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:50:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:55 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f 1073741824 Nov 02 15:50:55 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:55 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-0fac755d-5f3b-4313-b021-d6079540079b tempest-ProjectReaderTests-665207650 None] Create snapshot completed successfully Nov 02 15:50:55 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b1982cba-375e-4c08-a439-710068541ef9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c14a04ac-9d3f-4473-b42e-e3d8264a8163" returned: 0 in 0.417s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b1982cba-375e-4c08-a439-710068541ef9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c14a04ac-9d3f-4473-b42e-e3d8264a8163 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:56 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c14a04ac-9d3f-4473-b42e-e3d8264a8163 Nov 02 15:50:56 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:56 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b1982cba-375e-4c08-a439-710068541ef9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c14a04ac-9d3f-4473-b42e-e3d8264a8163" returned: 0 in 0.302s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:56 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f 1073741824" returned: 0 in 0.530s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b1982cba-375e-4c08-a439-710068541ef9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "cinder-quobyte-c14a04ac-9d3f-4473-b42e-e3d8264a8163" released by "delete_volume" :: held 0.774s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-9e3911c5-bb74-4dc5-9504-af2dc4ce807a tempest-ProjectReaderTests-665207650 None] Acquiring lock "cinder-7f166ee9-2036-43c7-a1ae-0ce9199a4597-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:56 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f Nov 02 15:50:56 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-9e3911c5-bb74-4dc5-9504-af2dc4ce807a tempest-ProjectReaderTests-665207650 None] Lock "cinder-7f166ee9-2036-43c7-a1ae-0ce9199a4597-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-9e3911c5-bb74-4dc5-9504-af2dc4ce807a tempest-ProjectReaderTests-665207650 None] Acquiring lock "cinder-quobyte-9c6032d2-c94c-4427-9515-be69537a294d" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-b1982cba-375e-4c08-a439-710068541ef9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Created reservations ['06e5dafc-6d9e-4eb9-af7f-06a1d3f974f6', '8034e70e-da88-4c86-867c-608cd526f95d', '4752f645-9962-4228-a349-0daa7c246612', 'eeacca37-1bca-4bcd-a709-192d9e585935'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-9e3911c5-bb74-4dc5-9504-af2dc4ce807a tempest-ProjectReaderTests-665207650 None] Lock "cinder-quobyte-9c6032d2-c94c-4427-9515-be69537a294d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-9e3911c5-bb74-4dc5-9504-af2dc4ce807a tempest-ProjectReaderTests-665207650 None] Acquiring lock "cinder-quobyte-7f166ee9-2036-43c7-a1ae-0ce9199a4597" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-9e3911c5-bb74-4dc5-9504-af2dc4ce807a tempest-ProjectReaderTests-665207650 None] Lock "cinder-quobyte-7f166ee9-2036-43c7-a1ae-0ce9199a4597" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-9e3911c5-bb74-4dc5-9504-af2dc4ce807a tempest-ProjectReaderTests-665207650 None] Deleting offline snapshot 7f166ee9-2036-43c7-a1ae-0ce9199a4597 of volume 9c6032d2-c94c-4427-9515-be69537a294d {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-9e3911c5-bb74-4dc5-9504-af2dc4ce807a tempest-ProjectReaderTests-665207650 None] snapshot_file for this snap is: volume-9c6032d2-c94c-4427-9515-be69537a294d.7f166ee9-2036-43c7-a1ae-0ce9199a4597 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6198a9e-e9c7-4134-8a79-d86ef8a6a05b]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9e3911c5-bb74-4dc5-9504-af2dc4ce807a tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d.7f166ee9-2036-43c7-a1ae-0ce9199a4597 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b1982cba-375e-4c08-a439-710068541ef9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b1982cba-375e-4c08-a439-710068541ef9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b1982cba-375e-4c08-a439-710068541ef9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b1982cba-375e-4c08-a439-710068541ef9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b1982cba-375e-4c08-a439-710068541ef9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b1982cba-375e-4c08-a439-710068541ef9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:56 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:50:56 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d569ce10-17fa-4aef-8977-df4ac3947b9b tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Acquiring lock "cinder-b4bf5054-b2fc-4a8b-a138-17bf08aa98d9-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d569ce10-17fa-4aef-8977-df4ac3947b9b tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "cinder-b4bf5054-b2fc-4a8b-a138-17bf08aa98d9-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:56 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d.7f166ee9-2036-43c7-a1ae-0ce9199a4597 Nov 02 15:50:56 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d569ce10-17fa-4aef-8977-df4ac3947b9b tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Acquiring lock "cinder-quobyte-b4bf5054-b2fc-4a8b-a138-17bf08aa98d9" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d569ce10-17fa-4aef-8977-df4ac3947b9b tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "cinder-quobyte-b4bf5054-b2fc-4a8b-a138-17bf08aa98d9" acquired by "delete_volume" :: waited 0.026s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:56 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f" returned: 0 in 0.481s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a10576b-b80d-43d0-94ab-da4f6cc32110]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d569ce10-17fa-4aef-8977-df4ac3947b9b tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b4bf5054-b2fc-4a8b-a138-17bf08aa98d9 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e228903-2b4e-4141-96be-43db5fe04c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7495bda-caa0-41bf-a3f7-573373b6b387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:50:56 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] Volume volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f (6264e590-3010-4d9e-a4c2-23cb492e1f5f): created successfully Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7495bda-caa0-41bf-a3f7-573373b6b387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:50:56 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] Flow 'volume_create_manager' (c509b86f-584f-4773-837a-024715702525) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:50:56 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-cb12bbe0-0eda-4814-bb96-13f775ac030d tempest-VolumeDependencyTests-169981801 None] Created volume successfully. Nov 02 15:50:57 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b4bf5054-b2fc-4a8b-a138-17bf08aa98d9 Nov 02 15:50:57 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:57 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b1982cba-375e-4c08-a439-710068541ef9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.418s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:57 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-b1982cba-375e-4c08-a439-710068541ef9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:50:57 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-b1982cba-375e-4c08-a439-710068541ef9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Deleted volume successfully. Nov 02 15:50:57 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b1982cba-375e-4c08-a439-710068541ef9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "cinder-c14a04ac-9d3f-4473-b42e-e3d8264a8163-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:57 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9e3911c5-bb74-4dc5-9504-af2dc4ce807a tempest-ProjectReaderTests-665207650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d.7f166ee9-2036-43c7-a1ae-0ce9199a4597" returned: 0 in 0.640s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-9e3911c5-bb74-4dc5-9504-af2dc4ce807a tempest-ProjectReaderTests-665207650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c6032d2-c94c-4427-9515-be69537a294d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:50:57 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7175c2-c958-4e95-b75a-f87125768367]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9e3911c5-bb74-4dc5-9504-af2dc4ce807a tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:57 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d569ce10-17fa-4aef-8977-df4ac3947b9b tempest-CreateVolumesFromSourceVolumeTest-717898997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b4bf5054-b2fc-4a8b-a138-17bf08aa98d9" returned: 0 in 0.450s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d569ce10-17fa-4aef-8977-df4ac3947b9b tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b4bf5054-b2fc-4a8b-a138-17bf08aa98d9 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:57 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b4bf5054-b2fc-4a8b-a138-17bf08aa98d9 Nov 02 15:50:57 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:57 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d Nov 02 15:50:57 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:57 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d569ce10-17fa-4aef-8977-df4ac3947b9b tempest-CreateVolumesFromSourceVolumeTest-717898997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b4bf5054-b2fc-4a8b-a138-17bf08aa98d9" returned: 0 in 0.257s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:57 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d569ce10-17fa-4aef-8977-df4ac3947b9b tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "cinder-quobyte-b4bf5054-b2fc-4a8b-a138-17bf08aa98d9" released by "delete_volume" :: held 0.777s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:57 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9e3911c5-bb74-4dc5-9504-af2dc4ce807a tempest-ProjectReaderTests-665207650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d" returned: 0 in 0.404s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9e3911c5-bb74-4dc5-9504-af2dc4ce807a tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d.7f166ee9-2036-43c7-a1ae-0ce9199a4597 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:57 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d.7f166ee9-2036-43c7-a1ae-0ce9199a4597 Nov 02 15:50:57 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:57 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-d569ce10-17fa-4aef-8977-df4ac3947b9b tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Created reservations ['9e63e2cb-b4e9-4916-a280-9d0b4ff235e4', '5eeca520-b3db-4254-b032-b2c41dbce910', 'e1f5f0ce-b5f4-47a6-83e3-031d762b6540', '4f586ab2-7949-42ee-96d3-d32fdfe1af5c'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:50:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d569ce10-17fa-4aef-8977-df4ac3947b9b tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d569ce10-17fa-4aef-8977-df4ac3947b9b tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d569ce10-17fa-4aef-8977-df4ac3947b9b tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d569ce10-17fa-4aef-8977-df4ac3947b9b tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d569ce10-17fa-4aef-8977-df4ac3947b9b tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d569ce10-17fa-4aef-8977-df4ac3947b9b tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:57 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:50:57 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:57 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7b08db76-df01-4c57-9b4a-13829f054ba9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Acquiring lock "cinder-64c96f67-829a-45be-a8c6-4f68029cdbf3-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:57 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7b08db76-df01-4c57-9b4a-13829f054ba9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "cinder-64c96f67-829a-45be-a8c6-4f68029cdbf3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:57 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7b08db76-df01-4c57-9b4a-13829f054ba9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Acquiring lock "cinder-quobyte-64c96f67-829a-45be-a8c6-4f68029cdbf3" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:57 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7b08db76-df01-4c57-9b4a-13829f054ba9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "cinder-quobyte-64c96f67-829a-45be-a8c6-4f68029cdbf3" acquired by "delete_volume" :: waited 0.023s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:58 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9e3911c5-bb74-4dc5-9504-af2dc4ce807a tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d.7f166ee9-2036-43c7-a1ae-0ce9199a4597" returned: 0 in 0.416s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9e3911c5-bb74-4dc5-9504-af2dc4ce807a tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d.7f166ee9-2036-43c7-a1ae-0ce9199a4597 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:58 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:58 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae91fb1-88dd-441c-9a6c-bb009036c522]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7b08db76-df01-4c57-9b4a-13829f054ba9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-64c96f67-829a-45be-a8c6-4f68029cdbf3 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d569ce10-17fa-4aef-8977-df4ac3947b9b tempest-CreateVolumesFromSourceVolumeTest-717898997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.329s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:58 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-d569ce10-17fa-4aef-8977-df4ac3947b9b tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:50:58 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d.7f166ee9-2036-43c7-a1ae-0ce9199a4597 Nov 02 15:50:58 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:58 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-d569ce10-17fa-4aef-8977-df4ac3947b9b tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Deleted volume successfully. Nov 02 15:50:58 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d569ce10-17fa-4aef-8977-df4ac3947b9b tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "cinder-b4bf5054-b2fc-4a8b-a138-17bf08aa98d9-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:58 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-64c96f67-829a-45be-a8c6-4f68029cdbf3 Nov 02 15:50:58 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0374ee56-acbb-4b7e-b822-5171bcd779cb tempest-VolumeDependencyTests-169981801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0374ee56-acbb-4b7e-b822-5171bcd779cb tempest-VolumeDependencyTests-169981801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:58 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-0374ee56-acbb-4b7e-b822-5171bcd779cb tempest-VolumeDependencyTests-169981801 None] Creating offline snapshot 3faf757b-9272-459c-959c-40fb337edfc4 of volume 6264e590-3010-4d9e-a4c2-23cb492e1f5f {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:50:58 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f60280-e987-4782-9416-6c071570759f]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0374ee56-acbb-4b7e-b822-5171bcd779cb tempest-VolumeDependencyTests-169981801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:58 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9e3911c5-bb74-4dc5-9504-af2dc4ce807a tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d.7f166ee9-2036-43c7-a1ae-0ce9199a4597" returned: 0 in 0.289s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:58 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-9e3911c5-bb74-4dc5-9504-af2dc4ce807a tempest-ProjectReaderTests-665207650 None] Lock "cinder-quobyte-7f166ee9-2036-43c7-a1ae-0ce9199a4597" released by "_delete_snapshot" :: held 1.904s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:58 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-9e3911c5-bb74-4dc5-9504-af2dc4ce807a tempest-ProjectReaderTests-665207650 None] Lock "cinder-quobyte-9c6032d2-c94c-4427-9515-be69537a294d" released by "delete_snapshot" :: held 1.933s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:58 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f Nov 02 15:50:58 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:58 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-9e3911c5-bb74-4dc5-9504-af2dc4ce807a tempest-ProjectReaderTests-665207650 None] Created reservations ['83e32367-17c9-428d-a463-8d74a4f30327', 'a5862c3d-fb4b-4778-877c-f743074ae1ca', '58d25405-3a85-4f29-a605-c85b7b7de153', 'cca5081b-5191-42af-bcdc-f970ec623b70'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:50:58 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-9e3911c5-bb74-4dc5-9504-af2dc4ce807a tempest-ProjectReaderTests-665207650 None] Delete snapshot completed successfully. Nov 02 15:50:58 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-9e3911c5-bb74-4dc5-9504-af2dc4ce807a tempest-ProjectReaderTests-665207650 None] Lock "cinder-7f166ee9-2036-43c7-a1ae-0ce9199a4597-delete_snapshot" released by "delete_snapshot" :: held 2.101s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:58 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7b08db76-df01-4c57-9b4a-13829f054ba9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-64c96f67-829a-45be-a8c6-4f68029cdbf3" returned: 0 in 0.522s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7b08db76-df01-4c57-9b4a-13829f054ba9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-64c96f67-829a-45be-a8c6-4f68029cdbf3 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:58 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-64c96f67-829a-45be-a8c6-4f68029cdbf3 Nov 02 15:50:58 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:58 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b1808045-a01a-4e2a-ba6b-13e6c84855ef tempest-ProjectReaderTests-665207650 None] Acquiring lock "cinder-9c6032d2-c94c-4427-9515-be69537a294d-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:58 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b1808045-a01a-4e2a-ba6b-13e6c84855ef tempest-ProjectReaderTests-665207650 None] Lock "cinder-9c6032d2-c94c-4427-9515-be69537a294d-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:58 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b1808045-a01a-4e2a-ba6b-13e6c84855ef tempest-ProjectReaderTests-665207650 None] Acquiring lock "cinder-quobyte-9c6032d2-c94c-4427-9515-be69537a294d" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:50:58 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b1808045-a01a-4e2a-ba6b-13e6c84855ef tempest-ProjectReaderTests-665207650 None] Lock "cinder-quobyte-9c6032d2-c94c-4427-9515-be69537a294d" acquired by "delete_volume" :: waited 0.023s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:50:58 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0374ee56-acbb-4b7e-b822-5171bcd779cb tempest-VolumeDependencyTests-169981801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f" returned: 0 in 0.467s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0374ee56-acbb-4b7e-b822-5171bcd779cb tempest-VolumeDependencyTests-169981801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f.3faf757b-9272-459c-959c-40fb337edfc4 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:58 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93fb1c4-568f-41cc-9047-6709ba785711]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:50:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b1808045-a01a-4e2a-ba6b-13e6c84855ef tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:58 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f.3faf757b-9272-459c-959c-40fb337edfc4 1G Nov 02 15:50:58 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:58 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d Nov 02 15:50:58 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:58 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7b08db76-df01-4c57-9b4a-13829f054ba9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-64c96f67-829a-45be-a8c6-4f68029cdbf3" returned: 0 in 0.370s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:58 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7b08db76-df01-4c57-9b4a-13829f054ba9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "cinder-quobyte-64c96f67-829a-45be-a8c6-4f68029cdbf3" released by "delete_volume" :: held 0.958s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:59 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-7b08db76-df01-4c57-9b4a-13829f054ba9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Created reservations ['48e647f7-ae41-44e5-a8be-0a84256538af', '3e62e285-fc85-4f71-abd9-f97b68ac8cf1', 'a146a9be-3256-4952-8a13-dc5067237cc4', '841ac5e4-d882-4a2f-9460-7ae77066373b'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:50:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7b08db76-df01-4c57-9b4a-13829f054ba9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7b08db76-df01-4c57-9b4a-13829f054ba9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7b08db76-df01-4c57-9b4a-13829f054ba9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7b08db76-df01-4c57-9b4a-13829f054ba9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7b08db76-df01-4c57-9b4a-13829f054ba9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7b08db76-df01-4c57-9b4a-13829f054ba9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:59 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:50:59 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:59 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b1808045-a01a-4e2a-ba6b-13e6c84855ef tempest-ProjectReaderTests-665207650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d" returned: 0 in 0.484s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b1808045-a01a-4e2a-ba6b-13e6c84855ef tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:59 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d Nov 02 15:50:59 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:59 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0374ee56-acbb-4b7e-b822-5171bcd779cb tempest-VolumeDependencyTests-169981801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f.3faf757b-9272-459c-959c-40fb337edfc4 1G" returned: 0 in 0.588s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0374ee56-acbb-4b7e-b822-5171bcd779cb tempest-VolumeDependencyTests-169981801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f.3faf757b-9272-459c-959c-40fb337edfc4 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:59 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f.3faf757b-9272-459c-959c-40fb337edfc4 Nov 02 15:50:59 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:59 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7b08db76-df01-4c57-9b4a-13829f054ba9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.273s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:59 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-7b08db76-df01-4c57-9b4a-13829f054ba9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:50:59 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-7b08db76-df01-4c57-9b4a-13829f054ba9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Deleted volume successfully. Nov 02 15:50:59 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7b08db76-df01-4c57-9b4a-13829f054ba9 tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "cinder-64c96f67-829a-45be-a8c6-4f68029cdbf3-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:59 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b1808045-a01a-4e2a-ba6b-13e6c84855ef tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-9c6032d2-c94c-4427-9515-be69537a294d" returned: 0 in 0.327s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:59 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b1808045-a01a-4e2a-ba6b-13e6c84855ef tempest-ProjectReaderTests-665207650 None] Lock "cinder-quobyte-9c6032d2-c94c-4427-9515-be69537a294d" released by "delete_volume" :: held 0.915s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:50:59 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-b1808045-a01a-4e2a-ba6b-13e6c84855ef tempest-ProjectReaderTests-665207650 None] Created reservations ['1973867d-d246-4f28-81e9-5730dc56fa49', '73232971-d9f3-4942-81a5-fa44fa11a89a', '604c4892-eebd-4054-bdc3-198d695b1de3', 'f2349e58-2778-4659-ad60-fa771c0b0c89'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:50:59 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0374ee56-acbb-4b7e-b822-5171bcd779cb tempest-VolumeDependencyTests-169981801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f.3faf757b-9272-459c-959c-40fb337edfc4" returned: 0 in 0.380s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:50:59 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-0374ee56-acbb-4b7e-b822-5171bcd779cb tempest-VolumeDependencyTests-169981801 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f.3faf757b-9272-459c-959c-40fb337edfc4 is being set with open permissions: ugo+rw Nov 02 15:50:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0374ee56-acbb-4b7e-b822-5171bcd779cb tempest-VolumeDependencyTests-169981801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f.3faf757b-9272-459c-959c-40fb337edfc4 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b1808045-a01a-4e2a-ba6b-13e6c84855ef tempest-ProjectReaderTests-665207650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:50:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b1808045-a01a-4e2a-ba6b-13e6c84855ef tempest-ProjectReaderTests-665207650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:50:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b1808045-a01a-4e2a-ba6b-13e6c84855ef tempest-ProjectReaderTests-665207650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:50:59 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f.3faf757b-9272-459c-959c-40fb337edfc4 Nov 02 15:50:59 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-b1808045-a01a-4e2a-ba6b-13e6c84855ef tempest-ProjectReaderTests-665207650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:50:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-b1808045-a01a-4e2a-ba6b-13e6c84855ef tempest-ProjectReaderTests-665207650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:50:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b1808045-a01a-4e2a-ba6b-13e6c84855ef tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:50:59 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:50:59 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:50:59 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Nov 02 15:50:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0374ee56-acbb-4b7e-b822-5171bcd779cb tempest-VolumeDependencyTests-169981801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f.3faf757b-9272-459c-959c-40fb337edfc4" returned: 0 in 0.273s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:00 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b1808045-a01a-4e2a-ba6b-13e6c84855ef tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.293s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-b1808045-a01a-4e2a-ba6b-13e6c84855ef tempest-ProjectReaderTests-665207650 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:51:00 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-b1808045-a01a-4e2a-ba6b-13e6c84855ef tempest-ProjectReaderTests-665207650 None] Deleted volume successfully. Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0374ee56-acbb-4b7e-b822-5171bcd779cb tempest-VolumeDependencyTests-169981801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b1808045-a01a-4e2a-ba6b-13e6c84855ef tempest-ProjectReaderTests-665207650 None] Lock "cinder-9c6032d2-c94c-4427-9515-be69537a294d-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:00 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f.info Nov 02 15:51:00 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6a741835-f572-413c-926f-464826f275ab tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Acquiring lock "cinder-ac6a4a4e-7207-44d3-a267-75ee50ab3256-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6a741835-f572-413c-926f-464826f275ab tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "cinder-ac6a4a4e-7207-44d3-a267-75ee50ab3256-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6a741835-f572-413c-926f-464826f275ab tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Acquiring lock "cinder-quobyte-ac6a4a4e-7207-44d3-a267-75ee50ab3256" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6a741835-f572-413c-926f-464826f275ab tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "cinder-quobyte-ac6a4a4e-7207-44d3-a267-75ee50ab3256" acquired by "delete_volume" :: waited 0.030s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f831cd5-9ba9-4596-97d3-1bf10f9046d9]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6a741835-f572-413c-926f-464826f275ab tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ac6a4a4e-7207-44d3-a267-75ee50ab3256 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:00 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0374ee56-acbb-4b7e-b822-5171bcd779cb tempest-VolumeDependencyTests-169981801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f.info" returned: 0 in 0.363s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:00 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-0374ee56-acbb-4b7e-b822-5171bcd779cb tempest-VolumeDependencyTests-169981801 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f.info is being set with open permissions: ugo+rw Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0374ee56-acbb-4b7e-b822-5171bcd779cb tempest-VolumeDependencyTests-169981801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:00 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ac6a4a4e-7207-44d3-a267-75ee50ab3256 Nov 02 15:51:00 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:00 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f.info Nov 02 15:51:00 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] Flow 'volume_create_manager' (96b4dac0-bd10-4d31-a8d5-2654413c919b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e552062-c906-42f0-9fcf-882b19fe73e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e552062-c906-42f0-9fcf-882b19fe73e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1374415319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=617bd1d1-ba25-41c8-9b9b-505b77332c5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081ecbd5e3694d9d9779db39943c12e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:51:00Z,use_quota=True,user_id='c8c5dd94e82a45439e6816d23423ecdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3dd828-d125-44cc-81da-d4defd76d011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a3dd828-d125-44cc-81da-d4defd76d011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4f1500b-bd4b-46ec-9b09-2ab50521caa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4f1500b-bd4b-46ec-9b09-2ab50521caa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '617bd1d1-ba25-41c8-9b9b-505b77332c5d', 'volume_name': 'volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4437aa2c-f6bd-4e3d-95c5-6e0f0429a7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4437aa2c-f6bd-4e3d-95c5-6e0f0429a7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b5d2da-ca61-45e7-9cd5-f630b9e80f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:00 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] Volume 617bd1d1-ba25-41c8-9b9b-505b77332c5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d', 'volume_size': 1} Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:00 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0374ee56-acbb-4b7e-b822-5171bcd779cb tempest-VolumeDependencyTests-169981801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f.info" returned: 0 in 0.286s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0374ee56-acbb-4b7e-b822-5171bcd779cb tempest-VolumeDependencyTests-169981801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.522s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.155s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1374415319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=617bd1d1-ba25-41c8-9b9b-505b77332c5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081ecbd5e3694d9d9779db39943c12e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:51:00Z,use_quota=True,user_id='c8c5dd94e82a45439e6816d23423ecdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] Creating volume 617bd1d1-ba25-41c8-9b9b-505b77332c5d {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:51:00 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:00 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6a741835-f572-413c-926f-464826f275ab tempest-CreateVolumesFromSourceVolumeTest-717898997 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ac6a4a4e-7207-44d3-a267-75ee50ab3256" returned: 0 in 0.452s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6a741835-f572-413c-926f-464826f275ab tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ac6a4a4e-7207-44d3-a267-75ee50ab3256 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:00 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d 1073741824 Nov 02 15:51:00 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:00 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ac6a4a4e-7207-44d3-a267-75ee50ab3256 Nov 02 15:51:00 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:00 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-0374ee56-acbb-4b7e-b822-5171bcd779cb tempest-VolumeDependencyTests-169981801 None] Create snapshot completed successfully Nov 02 15:51:01 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6a741835-f572-413c-926f-464826f275ab tempest-CreateVolumesFromSourceVolumeTest-717898997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-ac6a4a4e-7207-44d3-a267-75ee50ab3256" returned: 0 in 0.282s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:01 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6a741835-f572-413c-926f-464826f275ab tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "cinder-quobyte-ac6a4a4e-7207-44d3-a267-75ee50ab3256" released by "delete_volume" :: held 0.805s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:01 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-6a741835-f572-413c-926f-464826f275ab tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Created reservations ['c0521ac7-affd-4383-b849-7712071aeb3b', 'a50df381-2f12-42ba-9702-95efcdc303ef', '1cf0cc4a-2312-4176-ad97-77919b50f8f0', 'a4fe4db1-80c9-4682-849b-4ea21505be76'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:51:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-6a741835-f572-413c-926f-464826f275ab tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-6a741835-f572-413c-926f-464826f275ab tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:01 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-6a741835-f572-413c-926f-464826f275ab tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:51:01 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-6a741835-f572-413c-926f-464826f275ab tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:51:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-6a741835-f572-413c-926f-464826f275ab tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6a741835-f572-413c-926f-464826f275ab tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:01 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:51:01 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:01 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d 1073741824" returned: 0 in 0.554s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:01 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d Nov 02 15:51:01 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:01 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6a741835-f572-413c-926f-464826f275ab tempest-CreateVolumesFromSourceVolumeTest-717898997 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.410s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:01 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-6a741835-f572-413c-926f-464826f275ab tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:51:01 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-6a741835-f572-413c-926f-464826f275ab tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Deleted volume successfully. Nov 02 15:51:01 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6a741835-f572-413c-926f-464826f275ab tempest-CreateVolumesFromSourceVolumeTest-717898997 None] Lock "cinder-ac6a4a4e-7207-44d3-a267-75ee50ab3256-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:01 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d" returned: 0 in 0.408s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:01 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:51:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:01 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47b5d2da-ca61-45e7-9cd5-f630b9e80f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:01 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (430b5973-0424-40a8-8625-527c4b207ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:01 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] Volume volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d (617bd1d1-ba25-41c8-9b9b-505b77332c5d): created successfully Nov 02 15:51:01 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (430b5973-0424-40a8-8625-527c4b207ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:01 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] Flow 'volume_create_manager' (96b4dac0-bd10-4d31-a8d5-2654413c919b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:51:01 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-25688378-ec80-47a6-8388-153943341874 tempest-ProjectReaderTests-665207650 None] Created volume successfully. Nov 02 15:51:02 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:51:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Flow 'volume_create_manager' (45672b6c-a562-4bb1-88ec-4a2d0d461882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:51:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dc82302-c0c5-4b49-961f-92e27608ac84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dc82302-c0c5-4b49-961f-92e27608ac84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:51:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1094283877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d231524b-408b-44c6-b5c7-eebb2bf108bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0fd8a3c0736467e9e7a8864c99b9567',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:51:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3faf757b-9272-459c-959c-40fb337edfc4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:51:02Z,use_quota=True,user_id='3dc6457663604ddba690c430bca88a1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39ed38a8-3362-4ce4-b051-c7a369715c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39ed38a8-3362-4ce4-b051-c7a369715c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (914f8839-6854-4e88-a2ac-d73bc026e3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (914f8839-6854-4e88-a2ac-d73bc026e3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd231524b-408b-44c6-b5c7-eebb2bf108bb', 'volume_name': 'volume-d231524b-408b-44c6-b5c7-eebb2bf108bb', 'volume_size': 1, 'snapshot_id': '3faf757b-9272-459c-959c-40fb337edfc4'}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4563773c-9e9d-43cb-9d47-6e1a969a6f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4563773c-9e9d-43cb-9d47-6e1a969a6f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (366badeb-aa4f-4364-b615-837fc5768dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:02 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Volume d231524b-408b-44c6-b5c7-eebb2bf108bb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d231524b-408b-44c6-b5c7-eebb2bf108bb', 'volume_size': 1, 'snapshot_id': '3faf757b-9272-459c-959c-40fb337edfc4'} Nov 02 15:51:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:02 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Acquiring lock "cinder-quobyte-3faf757b-9272-459c-959c-40fb337edfc4-d231524b-408b-44c6-b5c7-eebb2bf108bb" by "_create_volume_from_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:02 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Lock "cinder-quobyte-3faf757b-9272-459c-959c-40fb337edfc4-d231524b-408b-44c6-b5c7-eebb2bf108bb" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Creating volume d231524b-408b-44c6-b5c7-eebb2bf108bb from snapshot 3faf757b-9272-459c-959c-40fb337edfc4 {{(pid=86703) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 15:51:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:51:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:51:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:51:02 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Acquiring lock "cinder-quobyte-d231524b-408b-44c6-b5c7-eebb2bf108bb" by "_copy_volume_from_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:02 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Lock "cinder-quobyte-d231524b-408b-44c6-b5c7-eebb2bf108bb" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] snapshot: 3faf757b-9272-459c-959c-40fb337edfc4, volume: d231524b-408b-44c6-b5c7-eebb2bf108bb, {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 15:51:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:51:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:51:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:02 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7049bc76-6790-4bfd-a37c-f65a135d7a60]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f.3faf757b-9272-459c-959c-40fb337edfc4 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:02 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f.3faf757b-9272-459c-959c-40fb337edfc4 Nov 02 15:51:02 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2002d500-94a7-494b-b7a8-e10961ab5742 tempest-ProjectReaderTests-665207650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:03 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f.3faf757b-9272-459c-959c-40fb337edfc4" returned: 0 in 0.470s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:03 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:51:03 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafc3387-fbf5-47bd-8d06-c1a94f547a6d]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:03 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f Nov 02 15:51:03 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:03 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f" returned: 0 in 0.405s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:03 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] will copy from snapshot at /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 15:51:03 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Creating direct copy from snapshot {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 15:51:03 devstack cinder-volume[86703]: DEBUG cinder.utils [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Path /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d231524b-408b-44c6-b5c7-eebb2bf108bb not found in is_blk_device check {{(pid=86703) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 15:51:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d231524b-408b-44c6-b5c7-eebb2bf108bb {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:03 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d231524b-408b-44c6-b5c7-eebb2bf108bb Nov 02 15:51:03 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:10 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d231524b-408b-44c6-b5c7-eebb2bf108bb" returned: 0 in 7.048s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:10 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Image conversion details: src /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f, size 1024.00 MB, duration 7.05 sec, destination /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d231524b-408b-44c6-b5c7-eebb2bf108bb {{(pid=86703) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 15:51:10 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Converted 1024.00 MB image at 145.24 MB/s Nov 02 15:51:10 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d231524b-408b-44c6-b5c7-eebb2bf108bb is being set with open permissions: ugo+rw Nov 02 15:51:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d231524b-408b-44c6-b5c7-eebb2bf108bb {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:10 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d231524b-408b-44c6-b5c7-eebb2bf108bb Nov 02 15:51:10 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:10 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:51:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Flow 'volume_create_manager' (d4c2c137-8141-49b8-bf7a-0d67be1c9df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:51:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9571e0bf-bfa3-4790-91e8-4a1047b2ea13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9571e0bf-bfa3-4790-91e8-4a1047b2ea13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e1cd2e-ee28-4f07-94e4-24689eef5fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6e737f53597448d837527747113054c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:51:11Z,use_quota=True,user_id='3224670475914762b46a0dd8a38b3b0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f0a61f4-199c-48e9-8782-846b1d749102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f0a61f4-199c-48e9-8782-846b1d749102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720fc689-5939-4725-ba4f-499ab3120ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:10 devstack cinder-volume[86703]: DEBUG cinder.image.glance [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Creating Keystone auth plugin from conf {{(pid=86703) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 02 15:51:10 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d231524b-408b-44c6-b5c7-eebb2bf108bb" returned: 0 in 0.318s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:10 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Lock "cinder-quobyte-d231524b-408b-44c6-b5c7-eebb2bf108bb" released by "_copy_volume_from_snapshot" :: held 8.373s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:10 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Lock "cinder-quobyte-3faf757b-9272-459c-959c-40fb337edfc4-d231524b-408b-44c6-b5c7-eebb2bf108bb" released by "_create_volume_from_snapshot" :: held 8.454s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.470s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2002d500-94a7-494b-b7a8-e10961ab5742 tempest-ProjectReaderTests-665207650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.087s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-2002d500-94a7-494b-b7a8-e10961ab5742 tempest-ProjectReaderTests-665207650 None] Creating offline snapshot 1f749fda-d3b4-4836-9496-981073e01914 of volume 617bd1d1-ba25-41c8-9b9b-505b77332c5d {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:51:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (366badeb-aa4f-4364-b615-837fc5768dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d231524b-408b-44c6-b5c7-eebb2bf108bb', 'volume_size': 1, 'snapshot_id': '3faf757b-9272-459c-959c-40fb337edfc4'}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bfbee35-1b9b-4932-b10a-e5ae24003190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:10 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9faeef-bafe-469f-b70c-c794da3f1bd8]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2002d500-94a7-494b-b7a8-e10961ab5742 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:11 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Volume volume-d231524b-408b-44c6-b5c7-eebb2bf108bb (d231524b-408b-44c6-b5c7-eebb2bf108bb): created successfully Nov 02 15:51:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bfbee35-1b9b-4932-b10a-e5ae24003190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Flow 'volume_create_manager' (45672b6c-a562-4bb1-88ec-4a2d0d461882) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:51:11 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d Nov 02 15:51:11 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:11 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:51:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] Flow 'volume_create_manager' (e0c301ec-647f-4f3d-a093-02e20b950cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:51:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aef7301e-89d7-420c-9bcc-57d5456a542b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aef7301e-89d7-420c-9bcc-57d5456a542b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1298403712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97767791-26fa-42c1-9057-6a29fc561273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827d8cd11cbc41f7a4c21b1c70539876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:51:11Z,use_quota=True,user_id='0541392587c44cffb180fd589c706d94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8baa2bb1-aff3-4d84-b279-52b5d996627f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8baa2bb1-aff3-4d84-b279-52b5d996627f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52d394a9-1f98-49af-abdc-e5fae8cea398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52d394a9-1f98-49af-abdc-e5fae8cea398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97767791-26fa-42c1-9057-6a29fc561273', 'volume_name': 'volume-97767791-26fa-42c1-9057-6a29fc561273', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64ae7252-7c51-42d3-90ad-c231c88ab372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64ae7252-7c51-42d3-90ad-c231c88ab372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a1edae9-c50f-4b25-ac68-b960045496bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:11 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] Volume 97767791-26fa-42c1-9057-6a29fc561273: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97767791-26fa-42c1-9057-6a29fc561273', 'volume_size': 1} Nov 02 15:51:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:11 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-4960a614-03ba-48a5-8fff-6ff90d49651c tempest-VolumeDependencyTests-169981801 None] Created volume successfully. Nov 02 15:51:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (720fc689-5939-4725-ba4f-499ab3120ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '20e1cd2e-ee28-4f07-94e4-24689eef5fe5', 'volume_name': 'volume-20e1cd2e-ee28-4f07-94e4-24689eef5fe5', 'volume_size': 1, 'image_id': 'd0035372-e629-475e-ab00-04548b969ee7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d0035372-e629-475e-ab00-04548b969ee7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1c290626f221bd9a15d6769f4863ed6b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c6e737f53597448d837527747113054c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8fba457056de2617e5a6861a7021da9ad013d1e8260b9acb3ce99e1605f6dcc1b0e63a50a1e629ba51aac1af7c7e1a825fe0c9d23f0e035cf7a574d9cbb3d2d4', 'id': 'd0035372-e629-475e-ab00-04548b969ee7', 'created_at': datetime.datetime(2026, 11, 2, 14, 51, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 14, 51, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d0035372-e629-475e-ab00-04548b969ee7/file', 'properties': {}}, 'image_service': }' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50c0dd07-df52-4970-ac46-8db23d171274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50c0dd07-df52-4970-ac46-8db23d171274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a4d9517-a4c1-4978-ae24-31ac5c8aa6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:11 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Volume 20e1cd2e-ee28-4f07-94e4-24689eef5fe5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-20e1cd2e-ee28-4f07-94e4-24689eef5fe5', 'volume_size': 1, 'image_id': 'd0035372-e629-475e-ab00-04548b969ee7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d0035372-e629-475e-ab00-04548b969ee7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1c290626f221bd9a15d6769f4863ed6b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c6e737f53597448d837527747113054c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8fba457056de2617e5a6861a7021da9ad013d1e8260b9acb3ce99e1605f6dcc1b0e63a50a1e629ba51aac1af7c7e1a825fe0c9d23f0e035cf7a574d9cbb3d2d4', 'id': 'd0035372-e629-475e-ab00-04548b969ee7', 'created_at': datetime.datetime(2026, 11, 2, 14, 51, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 14, 51, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d0035372-e629-475e-ab00-04548b969ee7/file', 'properties': {}}, 'image_service': } Nov 02 15:51:11 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Trying to clone 20e1cd2e-ee28-4f07-94e4-24689eef5fe5 from image d0035372-e629-475e-ab00-04548b969ee7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d0035372-e629-475e-ab00-04548b969ee7', 'metadata': {}}]). {{(pid=86703) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 02 15:51:11 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d0035372-e629-475e-ab00-04548b969ee7_46_8dmxtdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86703) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 02 15:51:11 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Image download 0.00 MB at 0.00 MB/s Nov 02 15:51:11 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[de982a17-83c0-4a26-b523-43302758995b]: (4, 'raw') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0035372-e629-475e-ab00-04548b969ee7_46_8dmxtdevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:11 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2002d500-94a7-494b-b7a8-e10961ab5742 tempest-ProjectReaderTests-665207650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d" returned: 0 in 0.427s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2002d500-94a7-494b-b7a8-e10961ab5742 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d.1f749fda-d3b4-4836-9496-981073e01914 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:11 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d.1f749fda-d3b4-4836-9496-981073e01914 1G Nov 02 15:51:11 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:11 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0035372-e629-475e-ab00-04548b969ee7_46_8dmxtdevstack@QuobyteHD Nov 02 15:51:11 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:11 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0035372-e629-475e-ab00-04548b969ee7_46_8dmxtdevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0035372-e629-475e-ab00-04548b969ee7_46_8dmxtdevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:11 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2002d500-94a7-494b-b7a8-e10961ab5742 tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d.1f749fda-d3b4-4836-9496-981073e01914 1G" returned: 0 in 0.412s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2002d500-94a7-494b-b7a8-e10961ab5742 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d.1f749fda-d3b4-4836-9496-981073e01914 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:11 devstack sudo[107242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d.1f749fda-d3b4-4836-9496-981073e01914 Nov 02 15:51:11 devstack sudo[107242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:11 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0035372-e629-475e-ab00-04548b969ee7_46_8dmxtdevstack@QuobyteHD Nov 02 15:51:11 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:12 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0035372-e629-475e-ab00-04548b969ee7_46_8dmxtdevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0035372-e629-475e-ab00-04548b969ee7_46_8dmxtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Temporary image d0035372-e629-475e-ab00-04548b969ee7 is fetched for user 3224670475914762b46a0dd8a38b3b0f. {{(pid=86703) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 02 15:51:12 devstack sudo[107242]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2002d500-94a7-494b-b7a8-e10961ab5742 tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d.1f749fda-d3b4-4836-9496-981073e01914" returned: 0 in 0.292s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:12 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-2002d500-94a7-494b-b7a8-e10961ab5742 tempest-ProjectReaderTests-665207650 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d.1f749fda-d3b4-4836-9496-981073e01914 is being set with open permissions: ugo+rw Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2002d500-94a7-494b-b7a8-e10961ab5742 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d.1f749fda-d3b4-4836-9496-981073e01914 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:12 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d.1f749fda-d3b4-4836-9496-981073e01914 Nov 02 15:51:12 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abdd5ba-a9d0-42c9-808b-8431eba81513]: (4, 'raw') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0035372-e629-475e-ab00-04548b969ee7_46_8dmxtdevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4cb5c061-ae7c-43ed-a52f-48e9243e032d tempest-VolumeDependencyTests-169981801 None] Acquiring lock "cinder-3faf757b-9272-459c-959c-40fb337edfc4-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4cb5c061-ae7c-43ed-a52f-48e9243e032d tempest-VolumeDependencyTests-169981801 None] Lock "cinder-3faf757b-9272-459c-959c-40fb337edfc4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4cb5c061-ae7c-43ed-a52f-48e9243e032d tempest-VolumeDependencyTests-169981801 None] Acquiring lock "cinder-quobyte-6264e590-3010-4d9e-a4c2-23cb492e1f5f" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4cb5c061-ae7c-43ed-a52f-48e9243e032d tempest-VolumeDependencyTests-169981801 None] Lock "cinder-quobyte-6264e590-3010-4d9e-a4c2-23cb492e1f5f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4cb5c061-ae7c-43ed-a52f-48e9243e032d tempest-VolumeDependencyTests-169981801 None] Acquiring lock "cinder-quobyte-3faf757b-9272-459c-959c-40fb337edfc4" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:12 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0035372-e629-475e-ab00-04548b969ee7_46_8dmxtdevstack@QuobyteHD Nov 02 15:51:12 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4cb5c061-ae7c-43ed-a52f-48e9243e032d tempest-VolumeDependencyTests-169981801 None] Lock "cinder-quobyte-3faf757b-9272-459c-959c-40fb337edfc4" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-4cb5c061-ae7c-43ed-a52f-48e9243e032d tempest-VolumeDependencyTests-169981801 None] Deleting offline snapshot 3faf757b-9272-459c-959c-40fb337edfc4 of volume 6264e590-3010-4d9e-a4c2-23cb492e1f5f {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-4cb5c061-ae7c-43ed-a52f-48e9243e032d tempest-VolumeDependencyTests-169981801 None] snapshot_file for this snap is: volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f.3faf757b-9272-459c-959c-40fb337edfc4 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ddc02b-b512-4f0c-8af7-3a91f2df5974]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4cb5c061-ae7c-43ed-a52f-48e9243e032d tempest-VolumeDependencyTests-169981801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f.3faf757b-9272-459c-959c-40fb337edfc4 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:12 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2002d500-94a7-494b-b7a8-e10961ab5742 tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d.1f749fda-d3b4-4836-9496-981073e01914" returned: 0 in 0.255s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2002d500-94a7-494b-b7a8-e10961ab5742 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:12 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d.info Nov 02 15:51:12 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:12 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f.3faf757b-9272-459c-959c-40fb337edfc4 Nov 02 15:51:12 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:12 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0035372-e629-475e-ab00-04548b969ee7_46_8dmxtdevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0035372-e629-475e-ab00-04548b969ee7_46_8dmxtdevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:12 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0035372-e629-475e-ab00-04548b969ee7_46_8dmxtdevstack@QuobyteHD Nov 02 15:51:12 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:12 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2002d500-94a7-494b-b7a8-e10961ab5742 tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d.info" returned: 0 in 0.282s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:12 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-2002d500-94a7-494b-b7a8-e10961ab5742 tempest-ProjectReaderTests-665207650 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d.info is being set with open permissions: ugo+rw Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2002d500-94a7-494b-b7a8-e10961ab5742 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:12 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d.info Nov 02 15:51:12 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:12 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4cb5c061-ae7c-43ed-a52f-48e9243e032d tempest-VolumeDependencyTests-169981801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f.3faf757b-9272-459c-959c-40fb337edfc4" returned: 0 in 0.413s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-4cb5c061-ae7c-43ed-a52f-48e9243e032d tempest-VolumeDependencyTests-169981801 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4590cd89-8652-4322-9175-c0eff2a114e7]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4cb5c061-ae7c-43ed-a52f-48e9243e032d tempest-VolumeDependencyTests-169981801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:12 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0035372-e629-475e-ab00-04548b969ee7_46_8dmxtdevstack@QuobyteHD" returned: 1 in 0.359s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0035372-e629-475e-ab00-04548b969ee7_46_8dmxtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:12 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f Nov 02 15:51:12 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:12 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2002d500-94a7-494b-b7a8-e10961ab5742 tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d.info" returned: 0 in 0.266s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2002d500-94a7-494b-b7a8-e10961ab5742 tempest-ProjectReaderTests-665207650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.047s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.767s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:51:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1298403712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97767791-26fa-42c1-9057-6a29fc561273,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827d8cd11cbc41f7a4c21b1c70539876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:51:11Z,use_quota=True,user_id='0541392587c44cffb180fd589c706d94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] Creating volume 97767791-26fa-42c1-9057-6a29fc561273 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:51:12 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:51:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-97767791-26fa-42c1-9057-6a29fc561273 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:13 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-97767791-26fa-42c1-9057-6a29fc561273 1073741824 Nov 02 15:51:13 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:13 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-2002d500-94a7-494b-b7a8-e10961ab5742 tempest-ProjectReaderTests-665207650 None] Create snapshot completed successfully Nov 02 15:51:13 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4cb5c061-ae7c-43ed-a52f-48e9243e032d tempest-VolumeDependencyTests-169981801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f" returned: 0 in 0.550s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4cb5c061-ae7c-43ed-a52f-48e9243e032d tempest-VolumeDependencyTests-169981801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f.3faf757b-9272-459c-959c-40fb337edfc4 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:13 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f.3faf757b-9272-459c-959c-40fb337edfc4 Nov 02 15:51:13 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:13 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-97767791-26fa-42c1-9057-6a29fc561273 1073741824" returned: 0 in 0.439s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-97767791-26fa-42c1-9057-6a29fc561273 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:13 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-97767791-26fa-42c1-9057-6a29fc561273 Nov 02 15:51:13 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:13 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4cb5c061-ae7c-43ed-a52f-48e9243e032d tempest-VolumeDependencyTests-169981801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f.3faf757b-9272-459c-959c-40fb337edfc4" returned: 0 in 0.391s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4cb5c061-ae7c-43ed-a52f-48e9243e032d tempest-VolumeDependencyTests-169981801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f.3faf757b-9272-459c-959c-40fb337edfc4 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:13 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-97767791-26fa-42c1-9057-6a29fc561273" returned: 0 in 0.274s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:13 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:51:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.875s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:13 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:51:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e1cd2e-ee28-4f07-94e4-24689eef5fe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6e737f53597448d837527747113054c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:51:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:51:11Z,use_quota=True,user_id='3224670475914762b46a0dd8a38b3b0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:51:13 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f.3faf757b-9272-459c-959c-40fb337edfc4 Nov 02 15:51:13 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Creating volume 20e1cd2e-ee28-4f07-94e4-24689eef5fe5 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:51:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:13 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:51:13 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:13 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:51:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:13 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:51:13 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:51:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-20e1cd2e-ee28-4f07-94e4-24689eef5fe5 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:13 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c2febdaf-9c58-4132-b1cc-79e136490992 tempest-ProjectReaderTests-665207650 None] Acquiring lock "cinder-1f749fda-d3b4-4836-9496-981073e01914-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:13 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-20e1cd2e-ee28-4f07-94e4-24689eef5fe5 1073741824 Nov 02 15:51:13 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:13 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a1edae9-c50f-4b25-ac68-b960045496bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97767791-26fa-42c1-9057-6a29fc561273', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:13 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (771107bc-b776-46fd-86cd-b6befc24ac93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:13 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c2febdaf-9c58-4132-b1cc-79e136490992 tempest-ProjectReaderTests-665207650 None] Lock "cinder-1f749fda-d3b4-4836-9496-981073e01914-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:13 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c2febdaf-9c58-4132-b1cc-79e136490992 tempest-ProjectReaderTests-665207650 None] Acquiring lock "cinder-quobyte-617bd1d1-ba25-41c8-9b9b-505b77332c5d" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:13 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] Volume volume-97767791-26fa-42c1-9057-6a29fc561273 (97767791-26fa-42c1-9057-6a29fc561273): created successfully Nov 02 15:51:13 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (771107bc-b776-46fd-86cd-b6befc24ac93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:13 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] Flow 'volume_create_manager' (e0c301ec-647f-4f3d-a093-02e20b950cbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:51:13 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c2febdaf-9c58-4132-b1cc-79e136490992 tempest-ProjectReaderTests-665207650 None] Lock "cinder-quobyte-617bd1d1-ba25-41c8-9b9b-505b77332c5d" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:13 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c2febdaf-9c58-4132-b1cc-79e136490992 tempest-ProjectReaderTests-665207650 None] Acquiring lock "cinder-quobyte-1f749fda-d3b4-4836-9496-981073e01914" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:13 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-8faadfae-7b01-4937-9939-c3bc22d59d2d tempest-ProjectReaderTests-242526760 None] Created volume successfully. Nov 02 15:51:13 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c2febdaf-9c58-4132-b1cc-79e136490992 tempest-ProjectReaderTests-665207650 None] Lock "cinder-quobyte-1f749fda-d3b4-4836-9496-981073e01914" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:13 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-c2febdaf-9c58-4132-b1cc-79e136490992 tempest-ProjectReaderTests-665207650 None] Deleting offline snapshot 1f749fda-d3b4-4836-9496-981073e01914 of volume 617bd1d1-ba25-41c8-9b9b-505b77332c5d {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:51:13 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-c2febdaf-9c58-4132-b1cc-79e136490992 tempest-ProjectReaderTests-665207650 None] snapshot_file for this snap is: volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d.1f749fda-d3b4-4836-9496-981073e01914 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:51:13 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[130136eb-4595-402f-8f63-35d36a9f079f]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c2febdaf-9c58-4132-b1cc-79e136490992 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d.1f749fda-d3b4-4836-9496-981073e01914 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:14 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4cb5c061-ae7c-43ed-a52f-48e9243e032d tempest-VolumeDependencyTests-169981801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f.3faf757b-9272-459c-959c-40fb337edfc4" returned: 0 in 0.309s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:14 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d.1f749fda-d3b4-4836-9496-981073e01914 Nov 02 15:51:14 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:14 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4cb5c061-ae7c-43ed-a52f-48e9243e032d tempest-VolumeDependencyTests-169981801 None] Lock "cinder-quobyte-3faf757b-9272-459c-959c-40fb337edfc4" released by "_delete_snapshot" :: held 1.791s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:14 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4cb5c061-ae7c-43ed-a52f-48e9243e032d tempest-VolumeDependencyTests-169981801 None] Lock "cinder-quobyte-6264e590-3010-4d9e-a4c2-23cb492e1f5f" released by "delete_snapshot" :: held 1.819s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:14 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-4cb5c061-ae7c-43ed-a52f-48e9243e032d tempest-VolumeDependencyTests-169981801 None] Created reservations ['40508ad3-1898-4371-9adf-18fda4c1b511', '4768ff2f-6bdd-430a-93ca-95731514da0f', 'bcc082e4-e505-48e5-931e-33e9572cd258', 'f09401e6-e95b-41a0-9e92-bfd9ec7ee75d'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:51:14 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-4cb5c061-ae7c-43ed-a52f-48e9243e032d tempest-VolumeDependencyTests-169981801 None] Delete snapshot completed successfully. Nov 02 15:51:14 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4cb5c061-ae7c-43ed-a52f-48e9243e032d tempest-VolumeDependencyTests-169981801 None] Lock "cinder-3faf757b-9272-459c-959c-40fb337edfc4-delete_snapshot" released by "delete_snapshot" :: held 1.991s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:14 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-20e1cd2e-ee28-4f07-94e4-24689eef5fe5 1073741824" returned: 0 in 0.559s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:14 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3096b9da-50ea-40ea-a6da-0412b160cc04 tempest-ProjectReaderTests-242526760 None] Acquiring lock "cinder-97767791-26fa-42c1-9057-6a29fc561273-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:14 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c2febdaf-9c58-4132-b1cc-79e136490992 tempest-ProjectReaderTests-665207650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d.1f749fda-d3b4-4836-9496-981073e01914" returned: 0 in 0.429s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:14 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-c2febdaf-9c58-4132-b1cc-79e136490992 tempest-ProjectReaderTests-665207650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:51:14 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3096b9da-50ea-40ea-a6da-0412b160cc04 tempest-ProjectReaderTests-242526760 None] Lock "cinder-97767791-26fa-42c1-9057-6a29fc561273-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:14 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de4b02e-3645-4e16-869c-87e049e1e87d]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c2febdaf-9c58-4132-b1cc-79e136490992 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-20e1cd2e-ee28-4f07-94e4-24689eef5fe5 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:14 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-73e2091e-65e8-4bb6-bff1-dd31e25b3ead tempest-VolumeDependencyTests-169981801 None] Acquiring lock "cinder-6264e590-3010-4d9e-a4c2-23cb492e1f5f-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:14 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-20e1cd2e-ee28-4f07-94e4-24689eef5fe5 Nov 02 15:51:14 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:14 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-73e2091e-65e8-4bb6-bff1-dd31e25b3ead tempest-VolumeDependencyTests-169981801 None] Lock "cinder-6264e590-3010-4d9e-a4c2-23cb492e1f5f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:14 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3096b9da-50ea-40ea-a6da-0412b160cc04 tempest-ProjectReaderTests-242526760 None] Acquiring lock "cinder-quobyte-97767791-26fa-42c1-9057-6a29fc561273" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:14 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3096b9da-50ea-40ea-a6da-0412b160cc04 tempest-ProjectReaderTests-242526760 None] Lock "cinder-quobyte-97767791-26fa-42c1-9057-6a29fc561273" acquired by "delete_volume" :: waited 0.026s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:14 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d Nov 02 15:51:14 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:14 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-73e2091e-65e8-4bb6-bff1-dd31e25b3ead tempest-VolumeDependencyTests-169981801 None] Acquiring lock "cinder-quobyte-6264e590-3010-4d9e-a4c2-23cb492e1f5f" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:14 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ce21e7-3ed2-4888-b279-b0789a9da209]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3096b9da-50ea-40ea-a6da-0412b160cc04 tempest-ProjectReaderTests-242526760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-97767791-26fa-42c1-9057-6a29fc561273 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:14 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-73e2091e-65e8-4bb6-bff1-dd31e25b3ead tempest-VolumeDependencyTests-169981801 None] Lock "cinder-quobyte-6264e590-3010-4d9e-a4c2-23cb492e1f5f" acquired by "delete_volume" :: waited 0.039s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:14 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecab7af0-beee-443a-8ec2-4add33d24e65]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-73e2091e-65e8-4bb6-bff1-dd31e25b3ead tempest-VolumeDependencyTests-169981801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:14 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:14 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-97767791-26fa-42c1-9057-6a29fc561273 Nov 02 15:51:14 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-20e1cd2e-ee28-4f07-94e4-24689eef5fe5" returned: 0 in 0.286s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:14 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] <== create_volume: return (968ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:51:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:14 devstack cinder-volume[86703]: DEBUG cinder.volume.volume_utils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Attempting download of d0035372-e629-475e-ab00-04548b969ee7 ((None, [{'url': 'file:///opt/stack/data/glance/images/d0035372-e629-475e-ab00-04548b969ee7', 'metadata': {}}])) to volume 20e1cd2e-ee28-4f07-94e4-24689eef5fe5. {{(pid=86703) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 02 15:51:14 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5d42ce-06be-465d-8b9e-9288d991beee]: (4, 'raw') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d0035372-e629-475e-ab00-04548b969ee7_h95xzbib {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:14 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f Nov 02 15:51:14 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:14 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c2febdaf-9c58-4132-b1cc-79e136490992 tempest-ProjectReaderTests-665207650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d" returned: 0 in 0.517s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c2febdaf-9c58-4132-b1cc-79e136490992 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d.1f749fda-d3b4-4836-9496-981073e01914 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:14 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d.1f749fda-d3b4-4836-9496-981073e01914 Nov 02 15:51:14 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:15 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:15 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d0035372-e629-475e-ab00-04548b969ee7_h95xzbib Nov 02 15:51:15 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3096b9da-50ea-40ea-a6da-0412b160cc04 tempest-ProjectReaderTests-242526760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-97767791-26fa-42c1-9057-6a29fc561273" returned: 0 in 0.460s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3096b9da-50ea-40ea-a6da-0412b160cc04 tempest-ProjectReaderTests-242526760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-97767791-26fa-42c1-9057-6a29fc561273 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:15 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-97767791-26fa-42c1-9057-6a29fc561273 Nov 02 15:51:15 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:15 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-73e2091e-65e8-4bb6-bff1-dd31e25b3ead tempest-VolumeDependencyTests-169981801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f" returned: 0 in 0.505s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-73e2091e-65e8-4bb6-bff1-dd31e25b3ead tempest-VolumeDependencyTests-169981801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:15 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f Nov 02 15:51:15 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:15 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d0035372-e629-475e-ab00-04548b969ee7_h95xzbib" returned: 0 in 0.390s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0035372-e629-475e-ab00-04548b969ee7_h95xzbib {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:15 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c2febdaf-9c58-4132-b1cc-79e136490992 tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d.1f749fda-d3b4-4836-9496-981073e01914" returned: 0 in 0.387s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c2febdaf-9c58-4132-b1cc-79e136490992 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d.1f749fda-d3b4-4836-9496-981073e01914 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:15 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:15 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d.1f749fda-d3b4-4836-9496-981073e01914 Nov 02 15:51:15 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3096b9da-50ea-40ea-a6da-0412b160cc04 tempest-ProjectReaderTests-242526760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-97767791-26fa-42c1-9057-6a29fc561273" returned: 0 in 0.311s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3096b9da-50ea-40ea-a6da-0412b160cc04 tempest-ProjectReaderTests-242526760 None] Lock "cinder-quobyte-97767791-26fa-42c1-9057-6a29fc561273" released by "delete_volume" :: held 0.840s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:15 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0035372-e629-475e-ab00-04548b969ee7_h95xzbib Nov 02 15:51:15 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-3096b9da-50ea-40ea-a6da-0412b160cc04 tempest-ProjectReaderTests-242526760 None] Created reservations ['91038411-0a74-4598-9e58-1a8bc468b25f', 'd10d57bc-d86e-4a04-9338-2500823fd1e8', 'a5d7911a-e668-4dc8-9f82-f8402635ebda', '597bfc2c-0082-4dd9-af2a-5c1d9455e3e5'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-3096b9da-50ea-40ea-a6da-0412b160cc04 tempest-ProjectReaderTests-242526760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-3096b9da-50ea-40ea-a6da-0412b160cc04 tempest-ProjectReaderTests-242526760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-3096b9da-50ea-40ea-a6da-0412b160cc04 tempest-ProjectReaderTests-242526760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-3096b9da-50ea-40ea-a6da-0412b160cc04 tempest-ProjectReaderTests-242526760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-3096b9da-50ea-40ea-a6da-0412b160cc04 tempest-ProjectReaderTests-242526760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3096b9da-50ea-40ea-a6da-0412b160cc04 tempest-ProjectReaderTests-242526760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:15 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-73e2091e-65e8-4bb6-bff1-dd31e25b3ead tempest-VolumeDependencyTests-169981801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6264e590-3010-4d9e-a4c2-23cb492e1f5f" returned: 0 in 0.406s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:15 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:51:15 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-73e2091e-65e8-4bb6-bff1-dd31e25b3ead tempest-VolumeDependencyTests-169981801 None] Lock "cinder-quobyte-6264e590-3010-4d9e-a4c2-23cb492e1f5f" released by "delete_volume" :: held 1.023s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:15 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c2febdaf-9c58-4132-b1cc-79e136490992 tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d.1f749fda-d3b4-4836-9496-981073e01914" returned: 0 in 0.326s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c2febdaf-9c58-4132-b1cc-79e136490992 tempest-ProjectReaderTests-665207650 None] Lock "cinder-quobyte-1f749fda-d3b4-4836-9496-981073e01914" released by "_delete_snapshot" :: held 1.818s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c2febdaf-9c58-4132-b1cc-79e136490992 tempest-ProjectReaderTests-665207650 None] Lock "cinder-quobyte-617bd1d1-ba25-41c8-9b9b-505b77332c5d" released by "delete_snapshot" :: held 1.855s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:15 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0035372-e629-475e-ab00-04548b969ee7_h95xzbib" returned: 1 in 0.424s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0035372-e629-475e-ab00-04548b969ee7_h95xzbib' failed. Not Retrying. {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b8c724-2d61-4c13-88f2-48497be2ad74]: (4, 'raw') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0035372-e629-475e-ab00-04548b969ee7_46_8dmxtdevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-73e2091e-65e8-4bb6-bff1-dd31e25b3ead tempest-VolumeDependencyTests-169981801 None] Created reservations ['3b972f38-ae00-43e5-804b-11792de3dd6f', 'b858286a-cccb-4d7f-bc08-c5684d7f2938', '1cb9cc8b-c0d3-4e3d-97c3-29662a78b47c', '79f522a3-89f2-40b7-af2f-171b473be8dc'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-c2febdaf-9c58-4132-b1cc-79e136490992 tempest-ProjectReaderTests-665207650 None] Created reservations ['be8d0058-6014-498d-a20e-41bf7962a152', 'afcf84d9-6792-4c15-a2f1-3b6c8b631935', 'a5ef603b-caff-47ee-afd6-833ac8eec0b8', 'ff4000d0-8a0f-4ea9-aa75-145aac5098d9'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-73e2091e-65e8-4bb6-bff1-dd31e25b3ead tempest-VolumeDependencyTests-169981801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-73e2091e-65e8-4bb6-bff1-dd31e25b3ead tempest-VolumeDependencyTests-169981801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-73e2091e-65e8-4bb6-bff1-dd31e25b3ead tempest-VolumeDependencyTests-169981801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:51:15 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0035372-e629-475e-ab00-04548b969ee7_46_8dmxtdevstack@QuobyteHD Nov 02 15:51:15 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-73e2091e-65e8-4bb6-bff1-dd31e25b3ead tempest-VolumeDependencyTests-169981801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-73e2091e-65e8-4bb6-bff1-dd31e25b3ead tempest-VolumeDependencyTests-169981801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-73e2091e-65e8-4bb6-bff1-dd31e25b3ead tempest-VolumeDependencyTests-169981801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:15 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:51:15 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:15 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-c2febdaf-9c58-4132-b1cc-79e136490992 tempest-ProjectReaderTests-665207650 None] Delete snapshot completed successfully. Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c2febdaf-9c58-4132-b1cc-79e136490992 tempest-ProjectReaderTests-665207650 None] Lock "cinder-1f749fda-d3b4-4836-9496-981073e01914-delete_snapshot" released by "delete_snapshot" :: held 2.119s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:15 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3096b9da-50ea-40ea-a6da-0412b160cc04 tempest-ProjectReaderTests-242526760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.405s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:15 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-3096b9da-50ea-40ea-a6da-0412b160cc04 tempest-ProjectReaderTests-242526760 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:51:16 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-3096b9da-50ea-40ea-a6da-0412b160cc04 tempest-ProjectReaderTests-242526760 None] Deleted volume successfully. Nov 02 15:51:16 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0e39bb6d-c110-4359-9a83-0736b777a571 tempest-ProjectReaderTests-665207650 None] Acquiring lock "cinder-617bd1d1-ba25-41c8-9b9b-505b77332c5d-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:16 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0e39bb6d-c110-4359-9a83-0736b777a571 tempest-ProjectReaderTests-665207650 None] Lock "cinder-617bd1d1-ba25-41c8-9b9b-505b77332c5d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:16 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3096b9da-50ea-40ea-a6da-0412b160cc04 tempest-ProjectReaderTests-242526760 None] Lock "cinder-97767791-26fa-42c1-9057-6a29fc561273-delete_volume" released by "delete_volume" :: held 1.728s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:16 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d0035372-e629-475e-ab00-04548b969ee7_46_8dmxtdevstack@QuobyteHD" returned: 0 in 0.451s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0035372-e629-475e-ab00-04548b969ee7_46_8dmxtdevstack@QuobyteHD {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:16 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-73e2091e-65e8-4bb6-bff1-dd31e25b3ead tempest-VolumeDependencyTests-169981801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.325s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:16 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-73e2091e-65e8-4bb6-bff1-dd31e25b3ead tempest-VolumeDependencyTests-169981801 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:51:16 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-73e2091e-65e8-4bb6-bff1-dd31e25b3ead tempest-VolumeDependencyTests-169981801 None] Deleted volume successfully. Nov 02 15:51:16 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0e39bb6d-c110-4359-9a83-0736b777a571 tempest-ProjectReaderTests-665207650 None] Acquiring lock "cinder-quobyte-617bd1d1-ba25-41c8-9b9b-505b77332c5d" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:16 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0e39bb6d-c110-4359-9a83-0736b777a571 tempest-ProjectReaderTests-665207650 None] Lock "cinder-quobyte-617bd1d1-ba25-41c8-9b9b-505b77332c5d" acquired by "delete_volume" :: waited 0.018s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:16 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-73e2091e-65e8-4bb6-bff1-dd31e25b3ead tempest-VolumeDependencyTests-169981801 None] Lock "cinder-6264e590-3010-4d9e-a4c2-23cb492e1f5f-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:16 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c493b9-3137-4eac-8d91-3476e96f0f80]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0e39bb6d-c110-4359-9a83-0736b777a571 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:16 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0035372-e629-475e-ab00-04548b969ee7_46_8dmxtdevstack@QuobyteHD Nov 02 15:51:16 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:16 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d Nov 02 15:51:16 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:16 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0035372-e629-475e-ab00-04548b969ee7_46_8dmxtdevstack@QuobyteHD" returned: 1 in 0.332s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d0035372-e629-475e-ab00-04548b969ee7_46_8dmxtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 02 15:51:16 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] d0035372-e629-475e-ab00-04548b969ee7 was raw, converting to qcow2 {{(pid=86703) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 02 15:51:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d0035372-e629-475e-ab00-04548b969ee7_46_8dmxtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-20e1cd2e-ee28-4f07-94e4-24689eef5fe5 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:16 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d0035372-e629-475e-ab00-04548b969ee7_46_8dmxtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-20e1cd2e-ee28-4f07-94e4-24689eef5fe5 Nov 02 15:51:16 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:16 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0e39bb6d-c110-4359-9a83-0736b777a571 tempest-ProjectReaderTests-665207650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d" returned: 0 in 0.436s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0e39bb6d-c110-4359-9a83-0736b777a571 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:16 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7aa0a4f9-31fb-41ef-b8cf-138c12cedc6f tempest-VolumeDependencyTests-169981801 None] Acquiring lock "cinder-d231524b-408b-44c6-b5c7-eebb2bf108bb-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:16 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d Nov 02 15:51:16 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:16 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7aa0a4f9-31fb-41ef-b8cf-138c12cedc6f tempest-VolumeDependencyTests-169981801 None] Lock "cinder-d231524b-408b-44c6-b5c7-eebb2bf108bb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:16 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7aa0a4f9-31fb-41ef-b8cf-138c12cedc6f tempest-VolumeDependencyTests-169981801 None] Acquiring lock "cinder-quobyte-d231524b-408b-44c6-b5c7-eebb2bf108bb" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:16 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7aa0a4f9-31fb-41ef-b8cf-138c12cedc6f tempest-VolumeDependencyTests-169981801 None] Lock "cinder-quobyte-d231524b-408b-44c6-b5c7-eebb2bf108bb" acquired by "delete_volume" :: waited 0.025s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:16 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bdf5f8-2eb1-4b0a-bcdf-0dd82e08e3bd]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7aa0a4f9-31fb-41ef-b8cf-138c12cedc6f tempest-VolumeDependencyTests-169981801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d231524b-408b-44c6-b5c7-eebb2bf108bb {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:17 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d231524b-408b-44c6-b5c7-eebb2bf108bb Nov 02 15:51:17 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:17 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0e39bb6d-c110-4359-9a83-0736b777a571 tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-617bd1d1-ba25-41c8-9b9b-505b77332c5d" returned: 0 in 0.384s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0e39bb6d-c110-4359-9a83-0736b777a571 tempest-ProjectReaderTests-665207650 None] Lock "cinder-quobyte-617bd1d1-ba25-41c8-9b9b-505b77332c5d" released by "delete_volume" :: held 0.904s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:17 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d0035372-e629-475e-ab00-04548b969ee7_46_8dmxtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-20e1cd2e-ee28-4f07-94e4-24689eef5fe5" returned: 0 in 0.717s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d0035372-e629-475e-ab00-04548b969ee7_46_8dmxtdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-20e1cd2e-ee28-4f07-94e4-24689eef5fe5 {{(pid=86703) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 15:51:17 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Converted 0.00 MB image at 0.00 MB/s Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-20e1cd2e-ee28-4f07-94e4-24689eef5fe5 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:17 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-20e1cd2e-ee28-4f07-94e4-24689eef5fe5 1G Nov 02 15:51:17 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-0e39bb6d-c110-4359-9a83-0736b777a571 tempest-ProjectReaderTests-665207650 None] Created reservations ['5abf344d-f52f-482f-9340-916b4afdeff1', 'ef4c8e5d-90a9-4b31-a17e-59eb967cb0fb', 'b701af36-f95a-40f8-b3b1-11932f593608', '8e5ec243-a27a-43c1-a2bf-4ff315e13cd2'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=226,cinder:UPDATE=303,cinder:INSERT=73,cinder:DELETE=23 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] Flow 'volume_create_manager' (1c3b9fae-0e3e-4d05-ae77-756a19d50579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac130417-f2a8-4650-8e6e-e3a7974af263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac130417-f2a8-4650-8e6e-e3a7974af263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-462376767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f57adc2-74b4-49ad-b94f-8f3fc290c183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827d8cd11cbc41f7a4c21b1c70539876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:51:17Z,use_quota=True,user_id='0541392587c44cffb180fd589c706d94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d22a4f14-48d7-4c29-bd7a-4753c638071c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:17 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d22a4f14-48d7-4c29-bd7a-4753c638071c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85a92485-dfd0-4eef-a0b9-a6d448ebc213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85a92485-dfd0-4eef-a0b9-a6d448ebc213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f57adc2-74b4-49ad-b94f-8f3fc290c183', 'volume_name': 'volume-7f57adc2-74b4-49ad-b94f-8f3fc290c183', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c2885d-27d1-4df8-a976-b76e8533c7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04c2885d-27d1-4df8-a976-b76e8533c7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a70833d9-d5a1-485e-af7f-1569a5b45613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:17 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] Volume 7f57adc2-74b4-49ad-b94f-8f3fc290c183: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f57adc2-74b4-49ad-b94f-8f3fc290c183', 'volume_size': 1} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-462376767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f57adc2-74b4-49ad-b94f-8f3fc290c183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827d8cd11cbc41f7a4c21b1c70539876',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:51:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:51:17Z,use_quota=True,user_id='0541392587c44cffb180fd589c706d94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] Creating volume 7f57adc2-74b4-49ad-b94f-8f3fc290c183 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:51:17 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7f57adc2-74b4-49ad-b94f-8f3fc290c183 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7aa0a4f9-31fb-41ef-b8cf-138c12cedc6f tempest-VolumeDependencyTests-169981801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d231524b-408b-44c6-b5c7-eebb2bf108bb" returned: 0 in 0.568s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7aa0a4f9-31fb-41ef-b8cf-138c12cedc6f tempest-VolumeDependencyTests-169981801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d231524b-408b-44c6-b5c7-eebb2bf108bb {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:17 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7f57adc2-74b4-49ad-b94f-8f3fc290c183 1073741824 Nov 02 15:51:17 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:17 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d231524b-408b-44c6-b5c7-eebb2bf108bb Nov 02 15:51:17 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0e39bb6d-c110-4359-9a83-0736b777a571 tempest-ProjectReaderTests-665207650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0e39bb6d-c110-4359-9a83-0736b777a571 tempest-ProjectReaderTests-665207650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-0e39bb6d-c110-4359-9a83-0736b777a571 tempest-ProjectReaderTests-665207650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-0e39bb6d-c110-4359-9a83-0736b777a571 tempest-ProjectReaderTests-665207650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0e39bb6d-c110-4359-9a83-0736b777a571 tempest-ProjectReaderTests-665207650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0e39bb6d-c110-4359-9a83-0736b777a571 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:17 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:51:17 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:17 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-20e1cd2e-ee28-4f07-94e4-24689eef5fe5 1G" returned: 0 in 0.385s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.volume.volume_utils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Downloaded image d0035372-e629-475e-ab00-04548b969ee7 ((None, [{'url': 'file:///opt/stack/data/glance/images/d0035372-e629-475e-ab00-04548b969ee7', 'metadata': {}}])) to volume 20e1cd2e-ee28-4f07-94e4-24689eef5fe5 successfully. {{(pid=86703) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Temporary image d0035372-e629-475e-ab00-04548b969ee7 for user 3224670475914762b46a0dd8a38b3b0f is deleted. {{(pid=86703) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.volume.volume_utils [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Marking volume 20e1cd2e-ee28-4f07-94e4-24689eef5fe5 as bootable. {{(pid=86703) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=230,cinder:UPDATE=322,cinder:INSERT=90,cinder:DELETE=31 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Copying metadata from image d0035372-e629-475e-ab00-04548b969ee7 to 20e1cd2e-ee28-4f07-94e4-24689eef5fe5. {{(pid=86703) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Creating volume glance metadata for volume 20e1cd2e-ee28-4f07-94e4-24689eef5fe5 backed by image d0035372-e629-475e-ab00-04548b969ee7 with: {'image_id': 'd0035372-e629-475e-ab00-04548b969ee7', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '1c290626f221bd9a15d6769f4863ed6b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86703) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 02 15:51:17 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7aa0a4f9-31fb-41ef-b8cf-138c12cedc6f tempest-VolumeDependencyTests-169981801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d231524b-408b-44c6-b5c7-eebb2bf108bb" returned: 0 in 0.297s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7aa0a4f9-31fb-41ef-b8cf-138c12cedc6f tempest-VolumeDependencyTests-169981801 None] Lock "cinder-quobyte-d231524b-408b-44c6-b5c7-eebb2bf108bb" released by "delete_volume" :: held 0.914s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:17 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0e39bb6d-c110-4359-9a83-0736b777a571 tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.266s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-0e39bb6d-c110-4359-9a83-0736b777a571 tempest-ProjectReaderTests-665207650 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:51:17 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-0e39bb6d-c110-4359-9a83-0736b777a571 tempest-ProjectReaderTests-665207650 None] Deleted volume successfully. Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a4d9517-a4c1-4978-ae24-31ac5c8aa6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20e1cd2e-ee28-4f07-94e4-24689eef5fe5', 'volume_size': 1, 'image_id': 'd0035372-e629-475e-ab00-04548b969ee7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d0035372-e629-475e-ab00-04548b969ee7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '1c290626f221bd9a15d6769f4863ed6b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c6e737f53597448d837527747113054c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '8fba457056de2617e5a6861a7021da9ad013d1e8260b9acb3ce99e1605f6dcc1b0e63a50a1e629ba51aac1af7c7e1a825fe0c9d23f0e035cf7a574d9cbb3d2d4', 'id': 'd0035372-e629-475e-ab00-04548b969ee7', 'created_at': datetime.datetime(2026, 11, 2, 14, 51, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 2, 14, 51, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d0035372-e629-475e-ab00-04548b969ee7/file', 'properties': {}}, 'image_service': }' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4abf19d-94b9-49e3-acc2-30e7e9b63d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-0e39bb6d-c110-4359-9a83-0736b777a571 tempest-ProjectReaderTests-665207650 None] Lock "cinder-617bd1d1-ba25-41c8-9b9b-505b77332c5d-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-7aa0a4f9-31fb-41ef-b8cf-138c12cedc6f tempest-VolumeDependencyTests-169981801 None] Created reservations ['10544250-9552-4223-836a-b87466b08e81', '07988746-6060-4c1a-8fca-0bf051efa388', '5731abeb-4a68-4b9b-9d17-8bd6b8d3ef59', '8324c966-13c6-46ed-8cbd-397681827e0c'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:51:17 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Volume volume-20e1cd2e-ee28-4f07-94e4-24689eef5fe5 (20e1cd2e-ee28-4f07-94e4-24689eef5fe5): created successfully Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4abf19d-94b9-49e3-acc2-30e7e9b63d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Flow 'volume_create_manager' (d4c2c137-8141-49b8-bf7a-0d67be1c9df3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:51:17 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7f57adc2-74b4-49ad-b94f-8f3fc290c183 1073741824" returned: 0 in 0.524s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:17 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-a811910c-4330-40b9-b3d8-523a9c547fac tempest-VolumeImageDependencyTests-646517499 None] Created volume successfully. Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7f57adc2-74b4-49ad-b94f-8f3fc290c183 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7aa0a4f9-31fb-41ef-b8cf-138c12cedc6f tempest-VolumeDependencyTests-169981801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7aa0a4f9-31fb-41ef-b8cf-138c12cedc6f tempest-VolumeDependencyTests-169981801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7aa0a4f9-31fb-41ef-b8cf-138c12cedc6f tempest-VolumeDependencyTests-169981801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:51:18 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7f57adc2-74b4-49ad-b94f-8f3fc290c183 Nov 02 15:51:18 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-7aa0a4f9-31fb-41ef-b8cf-138c12cedc6f tempest-VolumeDependencyTests-169981801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7aa0a4f9-31fb-41ef-b8cf-138c12cedc6f tempest-VolumeDependencyTests-169981801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7aa0a4f9-31fb-41ef-b8cf-138c12cedc6f tempest-VolumeDependencyTests-169981801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:18 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:51:18 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:18 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7f57adc2-74b4-49ad-b94f-8f3fc290c183" returned: 0 in 0.250s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a70833d9-d5a1-485e-af7f-1569a5b45613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f57adc2-74b4-49ad-b94f-8f3fc290c183', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0433dd22-6dc5-4686-b598-c83cba0c5fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3782f670-d590-42b4-b4e3-b0b417f3f7d8 tempest-VolumeImageDependencyTests-646517499 None] Acquiring lock "cinder-20e1cd2e-ee28-4f07-94e4-24689eef5fe5-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:18 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] Volume volume-7f57adc2-74b4-49ad-b94f-8f3fc290c183 (7f57adc2-74b4-49ad-b94f-8f3fc290c183): created successfully Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0433dd22-6dc5-4686-b598-c83cba0c5fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:18 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] Flow 'volume_create_manager' (1c3b9fae-0e3e-4d05-ae77-756a19d50579) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7aa0a4f9-31fb-41ef-b8cf-138c12cedc6f tempest-VolumeDependencyTests-169981801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.296s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-7aa0a4f9-31fb-41ef-b8cf-138c12cedc6f tempest-VolumeDependencyTests-169981801 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3782f670-d590-42b4-b4e3-b0b417f3f7d8 tempest-VolumeImageDependencyTests-646517499 None] Lock "cinder-20e1cd2e-ee28-4f07-94e4-24689eef5fe5-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:18 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-7aa0a4f9-31fb-41ef-b8cf-138c12cedc6f tempest-VolumeDependencyTests-169981801 None] Deleted volume successfully. Nov 02 15:51:18 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-ec46dfd9-e08b-495e-93c0-78f091eb0092 tempest-ProjectReaderTests-242526760 None] Created volume successfully. Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7aa0a4f9-31fb-41ef-b8cf-138c12cedc6f tempest-VolumeDependencyTests-169981801 None] Lock "cinder-d231524b-408b-44c6-b5c7-eebb2bf108bb-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3782f670-d590-42b4-b4e3-b0b417f3f7d8 tempest-VolumeImageDependencyTests-646517499 None] Acquiring lock "cinder-quobyte-20e1cd2e-ee28-4f07-94e4-24689eef5fe5" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3782f670-d590-42b4-b4e3-b0b417f3f7d8 tempest-VolumeImageDependencyTests-646517499 None] Lock "cinder-quobyte-20e1cd2e-ee28-4f07-94e4-24689eef5fe5" acquired by "delete_volume" :: waited 0.014s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4067301d-dd98-4646-943a-7c196d9f0853]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3782f670-d590-42b4-b4e3-b0b417f3f7d8 tempest-VolumeImageDependencyTests-646517499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-20e1cd2e-ee28-4f07-94e4-24689eef5fe5 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:18 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-20e1cd2e-ee28-4f07-94e4-24689eef5fe5 Nov 02 15:51:18 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:18 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3782f670-d590-42b4-b4e3-b0b417f3f7d8 tempest-VolumeImageDependencyTests-646517499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-20e1cd2e-ee28-4f07-94e4-24689eef5fe5" returned: 0 in 0.371s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3782f670-d590-42b4-b4e3-b0b417f3f7d8 tempest-VolumeImageDependencyTests-646517499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-20e1cd2e-ee28-4f07-94e4-24689eef5fe5 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:18 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-20e1cd2e-ee28-4f07-94e4-24689eef5fe5 Nov 02 15:51:18 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] Flow 'volume_create_manager' (e910b26c-a486-4e38-8caa-8da20847e9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e1f0f6-f82e-4557-b2f3-13c3b3a4c905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e1f0f6-f82e-4557-b2f3-13c3b3a4c905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1077487415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27c4221a-224d-46d1-b24c-5a5a742d63c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081ecbd5e3694d9d9779db39943c12e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:51:19Z,use_quota=True,user_id='c8c5dd94e82a45439e6816d23423ecdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd350ba7-eba0-43fa-9678-8326539b431e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd350ba7-eba0-43fa-9678-8326539b431e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7db81fe9-75bf-4b2f-a019-6c0ac8c63db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7db81fe9-75bf-4b2f-a019-6c0ac8c63db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27c4221a-224d-46d1-b24c-5a5a742d63c5', 'volume_name': 'volume-27c4221a-224d-46d1-b24c-5a5a742d63c5', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7aa326b-1b5e-472a-a0e8-41f8934e2238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7aa326b-1b5e-472a-a0e8-41f8934e2238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e92f3b-5781-480a-bf17-91e383292061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:18 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] Volume 27c4221a-224d-46d1-b24c-5a5a742d63c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27c4221a-224d-46d1-b24c-5a5a742d63c5', 'volume_size': 1} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1077487415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27c4221a-224d-46d1-b24c-5a5a742d63c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081ecbd5e3694d9d9779db39943c12e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:51:19Z,use_quota=True,user_id='c8c5dd94e82a45439e6816d23423ecdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] Creating volume 27c4221a-224d-46d1-b24c-5a5a742d63c5 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:51:18 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:51:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:19 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5 1073741824 Nov 02 15:51:19 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:19 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3782f670-d590-42b4-b4e3-b0b417f3f7d8 tempest-VolumeImageDependencyTests-646517499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-20e1cd2e-ee28-4f07-94e4-24689eef5fe5" returned: 0 in 0.289s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:19 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3782f670-d590-42b4-b4e3-b0b417f3f7d8 tempest-VolumeImageDependencyTests-646517499 None] Lock "cinder-quobyte-20e1cd2e-ee28-4f07-94e4-24689eef5fe5" released by "delete_volume" :: held 0.705s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:19 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-3782f670-d590-42b4-b4e3-b0b417f3f7d8 tempest-VolumeImageDependencyTests-646517499 None] Created reservations ['a592e8d9-0db3-4567-8d4c-c40b539cd941', 'cf36f135-e9c9-4f0f-8dcc-7bab1286a8e3', '5215807e-c33c-4e7e-9487-770ac7d50dc6', '7d9c54d6-61cb-4dc5-98f9-b984ceca8e55'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:51:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-3782f670-d590-42b4-b4e3-b0b417f3f7d8 tempest-VolumeImageDependencyTests-646517499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-3782f670-d590-42b4-b4e3-b0b417f3f7d8 tempest-VolumeImageDependencyTests-646517499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:19 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-3782f670-d590-42b4-b4e3-b0b417f3f7d8 tempest-VolumeImageDependencyTests-646517499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:51:19 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-3782f670-d590-42b4-b4e3-b0b417f3f7d8 tempest-VolumeImageDependencyTests-646517499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:51:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-3782f670-d590-42b4-b4e3-b0b417f3f7d8 tempest-VolumeImageDependencyTests-646517499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3782f670-d590-42b4-b4e3-b0b417f3f7d8 tempest-VolumeImageDependencyTests-646517499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:19 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:51:19 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:19 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3782f670-d590-42b4-b4e3-b0b417f3f7d8 tempest-VolumeImageDependencyTests-646517499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.267s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:19 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-3782f670-d590-42b4-b4e3-b0b417f3f7d8 tempest-VolumeImageDependencyTests-646517499 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:51:19 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:19 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-99559d3d-bfa7-4877-9c08-afe395bb625a tempest-ProjectReaderTests-242526760 None] Acquiring lock "cinder-7f57adc2-74b4-49ad-b94f-8f3fc290c183-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:19 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-3782f670-d590-42b4-b4e3-b0b417f3f7d8 tempest-VolumeImageDependencyTests-646517499 None] Deleted volume successfully. Nov 02 15:51:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5 1073741824" returned: 0 in 0.611s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:19 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-99559d3d-bfa7-4877-9c08-afe395bb625a tempest-ProjectReaderTests-242526760 None] Lock "cinder-7f57adc2-74b4-49ad-b94f-8f3fc290c183-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:19 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3782f670-d590-42b4-b4e3-b0b417f3f7d8 tempest-VolumeImageDependencyTests-646517499 None] Lock "cinder-20e1cd2e-ee28-4f07-94e4-24689eef5fe5-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:19 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-99559d3d-bfa7-4877-9c08-afe395bb625a tempest-ProjectReaderTests-242526760 None] Acquiring lock "cinder-quobyte-7f57adc2-74b4-49ad-b94f-8f3fc290c183" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:19 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5 Nov 02 15:51:19 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:19 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-99559d3d-bfa7-4877-9c08-afe395bb625a tempest-ProjectReaderTests-242526760 None] Lock "cinder-quobyte-7f57adc2-74b4-49ad-b94f-8f3fc290c183" acquired by "delete_volume" :: waited 0.031s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:19 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad12e09-fa53-4537-a66a-fe04c71746a5]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-99559d3d-bfa7-4877-9c08-afe395bb625a tempest-ProjectReaderTests-242526760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7f57adc2-74b4-49ad-b94f-8f3fc290c183 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:19 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7f57adc2-74b4-49ad-b94f-8f3fc290c183 Nov 02 15:51:19 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:20 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5" returned: 0 in 0.346s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:51:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e92f3b-5781-480a-bf17-91e383292061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27c4221a-224d-46d1-b24c-5a5a742d63c5', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eaab470-6b6d-42b3-90d4-d9b5a5b3a951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:20 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] Volume volume-27c4221a-224d-46d1-b24c-5a5a742d63c5 (27c4221a-224d-46d1-b24c-5a5a742d63c5): created successfully Nov 02 15:51:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eaab470-6b6d-42b3-90d4-d9b5a5b3a951) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] Flow 'volume_create_manager' (e910b26c-a486-4e38-8caa-8da20847e9f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:51:20 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-c8ff028b-a91c-4976-8de6-d890c508ba58 tempest-ProjectReaderTests-665207650 None] Created volume successfully. Nov 02 15:51:20 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-99559d3d-bfa7-4877-9c08-afe395bb625a tempest-ProjectReaderTests-242526760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7f57adc2-74b4-49ad-b94f-8f3fc290c183" returned: 0 in 0.428s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-99559d3d-bfa7-4877-9c08-afe395bb625a tempest-ProjectReaderTests-242526760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7f57adc2-74b4-49ad-b94f-8f3fc290c183 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:20 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7f57adc2-74b4-49ad-b94f-8f3fc290c183 Nov 02 15:51:20 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:20 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-99559d3d-bfa7-4877-9c08-afe395bb625a tempest-ProjectReaderTests-242526760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-7f57adc2-74b4-49ad-b94f-8f3fc290c183" returned: 0 in 0.320s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:20 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-99559d3d-bfa7-4877-9c08-afe395bb625a tempest-ProjectReaderTests-242526760 None] Lock "cinder-quobyte-7f57adc2-74b4-49ad-b94f-8f3fc290c183" released by "delete_volume" :: held 0.833s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:20 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:51:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:51:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:51:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:20 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-99559d3d-bfa7-4877-9c08-afe395bb625a tempest-ProjectReaderTests-242526760 None] Created reservations ['ef36c002-eaa6-45c8-8f15-500badce1b51', '80ddc6fe-2b3b-408b-8495-4a228140bf67', '76138cb5-839e-4163-a5d2-9bfd283285a6', '5184c5a0-ee85-4e42-a47f-c7bb3d9ce0ea'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:51:20 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:51:20 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-99559d3d-bfa7-4877-9c08-afe395bb625a tempest-ProjectReaderTests-242526760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-99559d3d-bfa7-4877-9c08-afe395bb625a tempest-ProjectReaderTests-242526760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-99559d3d-bfa7-4877-9c08-afe395bb625a tempest-ProjectReaderTests-242526760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:51:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-99559d3d-bfa7-4877-9c08-afe395bb625a tempest-ProjectReaderTests-242526760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:51:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-99559d3d-bfa7-4877-9c08-afe395bb625a tempest-ProjectReaderTests-242526760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-99559d3d-bfa7-4877-9c08-afe395bb625a tempest-ProjectReaderTests-242526760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:20 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:51:20 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:21 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.438s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:21 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:51:21 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager._thread_info {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:51:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread count: 29 {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 15:51:21 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread info: [<_MainThread(MainThread, started 125876361756800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 15:51:21 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-99559d3d-bfa7-4877-9c08-afe395bb625a tempest-ProjectReaderTests-242526760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.395s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:21 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-99559d3d-bfa7-4877-9c08-afe395bb625a tempest-ProjectReaderTests-242526760 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:51:21 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-99559d3d-bfa7-4877-9c08-afe395bb625a tempest-ProjectReaderTests-242526760 None] Deleted volume successfully. Nov 02 15:51:21 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-99559d3d-bfa7-4877-9c08-afe395bb625a tempest-ProjectReaderTests-242526760 None] Lock "cinder-7f57adc2-74b4-49ad-b94f-8f3fc290c183-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0f71bc68-1f35-4591-bea0-f2d908a64481 tempest-ProjectReaderTests-665207650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0f71bc68-1f35-4591-bea0-f2d908a64481 tempest-ProjectReaderTests-665207650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:21 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-0f71bc68-1f35-4591-bea0-f2d908a64481 tempest-ProjectReaderTests-665207650 None] Creating offline snapshot e023e60f-d846-4759-877a-6746037bbd56 of volume 27c4221a-224d-46d1-b24c-5a5a742d63c5 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:51:21 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3891ac5-eb39-44c7-841d-9157b552210d]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0f71bc68-1f35-4591-bea0-f2d908a64481 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:21 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5 Nov 02 15:51:21 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:21 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0f71bc68-1f35-4591-bea0-f2d908a64481 tempest-ProjectReaderTests-665207650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5" returned: 0 in 0.469s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0f71bc68-1f35-4591-bea0-f2d908a64481 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5.e023e60f-d846-4759-877a-6746037bbd56 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:21 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5.e023e60f-d846-4759-877a-6746037bbd56 1G Nov 02 15:51:21 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:22 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0f71bc68-1f35-4591-bea0-f2d908a64481 tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5.e023e60f-d846-4759-877a-6746037bbd56 1G" returned: 0 in 0.742s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0f71bc68-1f35-4591-bea0-f2d908a64481 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27c4221a-224d-46d1-b24c-5a5a742d63c5 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5.e023e60f-d846-4759-877a-6746037bbd56 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:22 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27c4221a-224d-46d1-b24c-5a5a742d63c5 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5.e023e60f-d846-4759-877a-6746037bbd56 Nov 02 15:51:22 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:23 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0f71bc68-1f35-4591-bea0-f2d908a64481 tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27c4221a-224d-46d1-b24c-5a5a742d63c5 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5.e023e60f-d846-4759-877a-6746037bbd56" returned: 0 in 0.372s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:23 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-0f71bc68-1f35-4591-bea0-f2d908a64481 tempest-ProjectReaderTests-665207650 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5.e023e60f-d846-4759-877a-6746037bbd56 is being set with open permissions: ugo+rw Nov 02 15:51:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0f71bc68-1f35-4591-bea0-f2d908a64481 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5.e023e60f-d846-4759-877a-6746037bbd56 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:23 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5.e023e60f-d846-4759-877a-6746037bbd56 Nov 02 15:51:23 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:23 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0f71bc68-1f35-4591-bea0-f2d908a64481 tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5.e023e60f-d846-4759-877a-6746037bbd56" returned: 0 in 0.230s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0f71bc68-1f35-4591-bea0-f2d908a64481 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:23 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5.info Nov 02 15:51:23 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:23 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0f71bc68-1f35-4591-bea0-f2d908a64481 tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5.info" returned: 0 in 0.391s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:23 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-0f71bc68-1f35-4591-bea0-f2d908a64481 tempest-ProjectReaderTests-665207650 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5.info is being set with open permissions: ugo+rw Nov 02 15:51:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0f71bc68-1f35-4591-bea0-f2d908a64481 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:23 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:51:23 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5.info Nov 02 15:51:23 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] Flow 'volume_create_manager' (e027d54e-cf7b-4092-a771-e5ded1402a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:51:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76a203c6-5d23-4772-bd83-57f8ec560537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76a203c6-5d23-4772-bd83-57f8ec560537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fceff2c5-48a5-41e3-992e-33ab1331b9d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a46f2d195604a8c8a5b4b8b52b2ee5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:51:24Z,use_quota=True,user_id='f68f2f45de484f2a9d382e4841888722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df0fbe01-917b-4427-b1b0-3d86c6ab33df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df0fbe01-917b-4427-b1b0-3d86c6ab33df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5ebf117-6461-4e78-b42a-cf9c38741f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5ebf117-6461-4e78-b42a-cf9c38741f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fceff2c5-48a5-41e3-992e-33ab1331b9d9', 'volume_name': 'volume-fceff2c5-48a5-41e3-992e-33ab1331b9d9', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b1e60d-f23b-4049-9c3b-6186629152ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9b1e60d-f23b-4049-9c3b-6186629152ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:23 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c048866a-ba1d-47a3-a240-e586c4155045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:23 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] Volume fceff2c5-48a5-41e3-992e-33ab1331b9d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fceff2c5-48a5-41e3-992e-33ab1331b9d9', 'volume_size': 1} Nov 02 15:51:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:24 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-0f71bc68-1f35-4591-bea0-f2d908a64481 tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5.info" returned: 0 in 0.299s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-0f71bc68-1f35-4591-bea0-f2d908a64481 tempest-ProjectReaderTests-665207650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.641s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.169s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fceff2c5-48a5-41e3-992e-33ab1331b9d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a46f2d195604a8c8a5b4b8b52b2ee5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:51:24Z,use_quota=True,user_id='f68f2f45de484f2a9d382e4841888722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:51:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] Creating volume fceff2c5-48a5-41e3-992e-33ab1331b9d9 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:51:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:51:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:51:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:51:24 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:51:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-fceff2c5-48a5-41e3-992e-33ab1331b9d9 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:24 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-fceff2c5-48a5-41e3-992e-33ab1331b9d9 1073741824 Nov 02 15:51:24 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:24 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-0f71bc68-1f35-4591-bea0-f2d908a64481 tempest-ProjectReaderTests-665207650 None] Create snapshot completed successfully Nov 02 15:51:24 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:24 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d4b0ff98-ecef-46d9-8105-a1becde5bd82 tempest-ProjectReaderTests-665207650 None] Acquiring lock "cinder-e023e60f-d846-4759-877a-6746037bbd56-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-fceff2c5-48a5-41e3-992e-33ab1331b9d9 1073741824" returned: 0 in 0.579s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:24 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d4b0ff98-ecef-46d9-8105-a1becde5bd82 tempest-ProjectReaderTests-665207650 None] Lock "cinder-e023e60f-d846-4759-877a-6746037bbd56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:24 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d4b0ff98-ecef-46d9-8105-a1becde5bd82 tempest-ProjectReaderTests-665207650 None] Acquiring lock "cinder-quobyte-27c4221a-224d-46d1-b24c-5a5a742d63c5" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:24 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d4b0ff98-ecef-46d9-8105-a1becde5bd82 tempest-ProjectReaderTests-665207650 None] Lock "cinder-quobyte-27c4221a-224d-46d1-b24c-5a5a742d63c5" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:24 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d4b0ff98-ecef-46d9-8105-a1becde5bd82 tempest-ProjectReaderTests-665207650 None] Acquiring lock "cinder-quobyte-e023e60f-d846-4759-877a-6746037bbd56" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-fceff2c5-48a5-41e3-992e-33ab1331b9d9 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:24 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d4b0ff98-ecef-46d9-8105-a1becde5bd82 tempest-ProjectReaderTests-665207650 None] Lock "cinder-quobyte-e023e60f-d846-4759-877a-6746037bbd56" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-d4b0ff98-ecef-46d9-8105-a1becde5bd82 tempest-ProjectReaderTests-665207650 None] Deleting offline snapshot e023e60f-d846-4759-877a-6746037bbd56 of volume 27c4221a-224d-46d1-b24c-5a5a742d63c5 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:51:24 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-fceff2c5-48a5-41e3-992e-33ab1331b9d9 Nov 02 15:51:24 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:24 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-d4b0ff98-ecef-46d9-8105-a1becde5bd82 tempest-ProjectReaderTests-665207650 None] snapshot_file for this snap is: volume-27c4221a-224d-46d1-b24c-5a5a742d63c5.e023e60f-d846-4759-877a-6746037bbd56 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:51:24 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dd5bac3f-648d-487b-a668-391157bc542d tempest-ProjectAdminTests-781351580 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8291549682617, 'free_capacity_gb': 1773.8291549682617, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86703) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 02 15:51:24 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c559c4-0d35-4e25-bb62-46f492b8f6eb]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d4b0ff98-ecef-46d9-8105-a1becde5bd82 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5.e023e60f-d846-4759-877a-6746037bbd56 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:24 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5.e023e60f-d846-4759-877a-6746037bbd56 Nov 02 15:51:24 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:25 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-fceff2c5-48a5-41e3-992e-33ab1331b9d9" returned: 0 in 0.360s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:51:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c048866a-ba1d-47a3-a240-e586c4155045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fceff2c5-48a5-41e3-992e-33ab1331b9d9', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be79db3d-09a3-435c-ae78-cce138645891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:25 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] Volume volume-fceff2c5-48a5-41e3-992e-33ab1331b9d9 (fceff2c5-48a5-41e3-992e-33ab1331b9d9): created successfully Nov 02 15:51:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be79db3d-09a3-435c-ae78-cce138645891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:25 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] Flow 'volume_create_manager' (e027d54e-cf7b-4092-a771-e5ded1402a98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:51:25 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-62e08fda-3d0f-49aa-897c-3faac885ed27 tempest-CinderUnicodeTest-462902868 None] Created volume successfully. Nov 02 15:51:25 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d4b0ff98-ecef-46d9-8105-a1becde5bd82 tempest-ProjectReaderTests-665207650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5.e023e60f-d846-4759-877a-6746037bbd56" returned: 0 in 0.430s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-d4b0ff98-ecef-46d9-8105-a1becde5bd82 tempest-ProjectReaderTests-665207650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27c4221a-224d-46d1-b24c-5a5a742d63c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:51:25 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5ea376-ea6b-4918-ae15-b33ff858c39d]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d4b0ff98-ecef-46d9-8105-a1becde5bd82 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:25 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5 Nov 02 15:51:25 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:25 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d4b0ff98-ecef-46d9-8105-a1becde5bd82 tempest-ProjectReaderTests-665207650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5" returned: 0 in 0.383s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d4b0ff98-ecef-46d9-8105-a1becde5bd82 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5.e023e60f-d846-4759-877a-6746037bbd56 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:25 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5.e023e60f-d846-4759-877a-6746037bbd56 Nov 02 15:51:25 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:26 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d4b0ff98-ecef-46d9-8105-a1becde5bd82 tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5.e023e60f-d846-4759-877a-6746037bbd56" returned: 0 in 0.472s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d4b0ff98-ecef-46d9-8105-a1becde5bd82 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5.e023e60f-d846-4759-877a-6746037bbd56 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:26 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5.e023e60f-d846-4759-877a-6746037bbd56 Nov 02 15:51:26 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:26 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d4b0ff98-ecef-46d9-8105-a1becde5bd82 tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5.e023e60f-d846-4759-877a-6746037bbd56" returned: 0 in 0.359s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:26 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d4b0ff98-ecef-46d9-8105-a1becde5bd82 tempest-ProjectReaderTests-665207650 None] Lock "cinder-quobyte-e023e60f-d846-4759-877a-6746037bbd56" released by "_delete_snapshot" :: held 1.791s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:26 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d4b0ff98-ecef-46d9-8105-a1becde5bd82 tempest-ProjectReaderTests-665207650 None] Lock "cinder-quobyte-27c4221a-224d-46d1-b24c-5a5a742d63c5" released by "delete_snapshot" :: held 1.845s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:26 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:51:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] Flow 'volume_create_manager' (23e27a00-4ccb-4fa6-9ed0-2f38837ff23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:51:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f373ccd7-687a-4c31-8788-1c8c4879e007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f373ccd7-687a-4c31-8788-1c8c4879e007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:51:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-146156578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b269a692-06c9-41ed-8a17-f3c83b42b21c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a46f2d195604a8c8a5b4b8b52b2ee5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:51:27Z,use_quota=True,user_id='f68f2f45de484f2a9d382e4841888722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fce49927-2d87-4ae8-8c72-c4a0304c876e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fce49927-2d87-4ae8-8c72-c4a0304c876e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ac56435-3340-4519-8659-1e67c7bc9bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ac56435-3340-4519-8659-1e67c7bc9bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b269a692-06c9-41ed-8a17-f3c83b42b21c', 'volume_name': 'volume-b269a692-06c9-41ed-8a17-f3c83b42b21c', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef0c37ee-2ce8-4fe4-b9f7-783bccca54ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef0c37ee-2ce8-4fe4-b9f7-783bccca54ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (369ce909-aea8-4b6d-bd00-625339d4e1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:26 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] Volume b269a692-06c9-41ed-8a17-f3c83b42b21c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b269a692-06c9-41ed-8a17-f3c83b42b21c', 'volume_size': 1} Nov 02 15:51:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:51:26Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-146156578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b269a692-06c9-41ed-8a17-f3c83b42b21c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a46f2d195604a8c8a5b4b8b52b2ee5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:51:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:51:27Z,use_quota=True,user_id='f68f2f45de484f2a9d382e4841888722',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:51:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] Creating volume b269a692-06c9-41ed-8a17-f3c83b42b21c {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:51:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:51:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:51:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:51:26 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:51:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:26 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c 1073741824 Nov 02 15:51:26 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-d4b0ff98-ecef-46d9-8105-a1becde5bd82 tempest-ProjectReaderTests-665207650 None] Created reservations ['4107f01a-7b58-4cc4-9c86-cb14b79099c2', 'eb1c72b9-06dc-4479-aec2-cb6d8d1b97cb', 'd449b0ad-fc28-4caa-adea-88aa8f83ed7a', 'b531aecc-c111-4783-bab3-af545ddf3b69'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:51:26 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:26 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-d4b0ff98-ecef-46d9-8105-a1becde5bd82 tempest-ProjectReaderTests-665207650 None] Delete snapshot completed successfully. Nov 02 15:51:26 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d4b0ff98-ecef-46d9-8105-a1becde5bd82 tempest-ProjectReaderTests-665207650 None] Lock "cinder-e023e60f-d846-4759-877a-6746037bbd56-delete_snapshot" released by "delete_snapshot" :: held 2.252s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:26 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-22e09904-e2fa-4044-a946-d9d2427a4f68 tempest-ProjectReaderTests-665207650 None] Acquiring lock "cinder-27c4221a-224d-46d1-b24c-5a5a742d63c5-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:26 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-22e09904-e2fa-4044-a946-d9d2427a4f68 tempest-ProjectReaderTests-665207650 None] Lock "cinder-27c4221a-224d-46d1-b24c-5a5a742d63c5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-22e09904-e2fa-4044-a946-d9d2427a4f68 tempest-ProjectReaderTests-665207650 None] Acquiring lock "cinder-quobyte-27c4221a-224d-46d1-b24c-5a5a742d63c5" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-22e09904-e2fa-4044-a946-d9d2427a4f68 tempest-ProjectReaderTests-665207650 None] Lock "cinder-quobyte-27c4221a-224d-46d1-b24c-5a5a742d63c5" acquired by "delete_volume" :: waited 0.029s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:27 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c392407d-56a7-4996-8afc-47247aaf5607]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-22e09904-e2fa-4044-a946-d9d2427a4f68 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:27 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5 Nov 02 15:51:27 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:27 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c 1073741824" returned: 0 in 0.570s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:27 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c Nov 02 15:51:27 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:27 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-22e09904-e2fa-4044-a946-d9d2427a4f68 tempest-ProjectReaderTests-665207650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5" returned: 0 in 0.447s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-22e09904-e2fa-4044-a946-d9d2427a4f68 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:27 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5 Nov 02 15:51:27 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:27 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c" returned: 0 in 0.328s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:27 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:51:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (369ce909-aea8-4b6d-bd00-625339d4e1bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b269a692-06c9-41ed-8a17-f3c83b42b21c', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7014884f-a650-4a8f-9785-f8a455abef2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:27 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] Volume volume-b269a692-06c9-41ed-8a17-f3c83b42b21c (b269a692-06c9-41ed-8a17-f3c83b42b21c): created successfully Nov 02 15:51:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7014884f-a650-4a8f-9785-f8a455abef2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:27 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] Flow 'volume_create_manager' (23e27a00-4ccb-4fa6-9ed0-2f38837ff23d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:51:27 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-39f30b4e-1c1c-404a-9d39-7bfad571c3f4 tempest-CinderUnicodeTest-462902868 None] Created volume successfully. Nov 02 15:51:27 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-22e09904-e2fa-4044-a946-d9d2427a4f68 tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-27c4221a-224d-46d1-b24c-5a5a742d63c5" returned: 0 in 0.276s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:27 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-22e09904-e2fa-4044-a946-d9d2427a4f68 tempest-ProjectReaderTests-665207650 None] Lock "cinder-quobyte-27c4221a-224d-46d1-b24c-5a5a742d63c5" released by "delete_volume" :: held 0.799s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:27 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-22e09904-e2fa-4044-a946-d9d2427a4f68 tempest-ProjectReaderTests-665207650 None] Created reservations ['0240a7f3-366f-42b5-8fca-08dfb5808cce', '8c63290a-360a-43a9-b331-a6353a206de0', '82443737-d30c-4556-9a7d-743ae985fd7b', '96573868-68f8-4f2b-a27a-00843dcddce4'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:51:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-22e09904-e2fa-4044-a946-d9d2427a4f68 tempest-ProjectReaderTests-665207650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-22e09904-e2fa-4044-a946-d9d2427a4f68 tempest-ProjectReaderTests-665207650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:27 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-22e09904-e2fa-4044-a946-d9d2427a4f68 tempest-ProjectReaderTests-665207650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:51:27 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-22e09904-e2fa-4044-a946-d9d2427a4f68 tempest-ProjectReaderTests-665207650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:51:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-22e09904-e2fa-4044-a946-d9d2427a4f68 tempest-ProjectReaderTests-665207650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-22e09904-e2fa-4044-a946-d9d2427a4f68 tempest-ProjectReaderTests-665207650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:28 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:51:28 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:28 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-22e09904-e2fa-4044-a946-d9d2427a4f68 tempest-ProjectReaderTests-665207650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.291s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:28 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-22e09904-e2fa-4044-a946-d9d2427a4f68 tempest-ProjectReaderTests-665207650 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:51:28 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-22e09904-e2fa-4044-a946-d9d2427a4f68 tempest-ProjectReaderTests-665207650 None] Deleted volume successfully. Nov 02 15:51:28 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-22e09904-e2fa-4044-a946-d9d2427a4f68 tempest-ProjectReaderTests-665207650 None] Lock "cinder-27c4221a-224d-46d1-b24c-5a5a742d63c5-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-bd61154f-a3cb-440d-87cb-cb2c1c59ff19 tempest-CinderUnicodeTest-462902868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-bd61154f-a3cb-440d-87cb-cb2c1c59ff19 tempest-CinderUnicodeTest-462902868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-bd61154f-a3cb-440d-87cb-cb2c1c59ff19 tempest-CinderUnicodeTest-462902868 None] Creating offline snapshot ae80925d-4e89-42e2-b52f-bf0ecca82582 of volume b269a692-06c9-41ed-8a17-f3c83b42b21c {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:51:29 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd12616f-b006-4220-bd7b-d8e3d70a1d7c]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bd61154f-a3cb-440d-87cb-cb2c1c59ff19 tempest-CinderUnicodeTest-462902868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:29 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c Nov 02 15:51:29 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:29 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bd61154f-a3cb-440d-87cb-cb2c1c59ff19 tempest-CinderUnicodeTest-462902868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c" returned: 0 in 0.403s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bd61154f-a3cb-440d-87cb-cb2c1c59ff19 tempest-CinderUnicodeTest-462902868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c.ae80925d-4e89-42e2-b52f-bf0ecca82582 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:29 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c.ae80925d-4e89-42e2-b52f-bf0ecca82582 1G Nov 02 15:51:29 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:30 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bd61154f-a3cb-440d-87cb-cb2c1c59ff19 tempest-CinderUnicodeTest-462902868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c.ae80925d-4e89-42e2-b52f-bf0ecca82582 1G" returned: 0 in 0.570s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bd61154f-a3cb-440d-87cb-cb2c1c59ff19 tempest-CinderUnicodeTest-462902868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b269a692-06c9-41ed-8a17-f3c83b42b21c -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c.ae80925d-4e89-42e2-b52f-bf0ecca82582 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:30 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b269a692-06c9-41ed-8a17-f3c83b42b21c -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c.ae80925d-4e89-42e2-b52f-bf0ecca82582 Nov 02 15:51:30 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:30 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bd61154f-a3cb-440d-87cb-cb2c1c59ff19 tempest-CinderUnicodeTest-462902868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b269a692-06c9-41ed-8a17-f3c83b42b21c -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c.ae80925d-4e89-42e2-b52f-bf0ecca82582" returned: 0 in 0.378s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:30 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-bd61154f-a3cb-440d-87cb-cb2c1c59ff19 tempest-CinderUnicodeTest-462902868 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c.ae80925d-4e89-42e2-b52f-bf0ecca82582 is being set with open permissions: ugo+rw Nov 02 15:51:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bd61154f-a3cb-440d-87cb-cb2c1c59ff19 tempest-CinderUnicodeTest-462902868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c.ae80925d-4e89-42e2-b52f-bf0ecca82582 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:30 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c.ae80925d-4e89-42e2-b52f-bf0ecca82582 Nov 02 15:51:30 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:30 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bd61154f-a3cb-440d-87cb-cb2c1c59ff19 tempest-CinderUnicodeTest-462902868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c.ae80925d-4e89-42e2-b52f-bf0ecca82582" returned: 0 in 0.324s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bd61154f-a3cb-440d-87cb-cb2c1c59ff19 tempest-CinderUnicodeTest-462902868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:30 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c.info Nov 02 15:51:30 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:31 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bd61154f-a3cb-440d-87cb-cb2c1c59ff19 tempest-CinderUnicodeTest-462902868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c.info" returned: 0 in 0.356s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:31 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-bd61154f-a3cb-440d-87cb-cb2c1c59ff19 tempest-CinderUnicodeTest-462902868 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c.info is being set with open permissions: ugo+rw Nov 02 15:51:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bd61154f-a3cb-440d-87cb-cb2c1c59ff19 tempest-CinderUnicodeTest-462902868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:31 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c.info Nov 02 15:51:31 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:31 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-bd61154f-a3cb-440d-87cb-cb2c1c59ff19 tempest-CinderUnicodeTest-462902868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c.info" returned: 0 in 0.274s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-bd61154f-a3cb-440d-87cb-cb2c1c59ff19 tempest-CinderUnicodeTest-462902868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.425s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:31 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-bd61154f-a3cb-440d-87cb-cb2c1c59ff19 tempest-CinderUnicodeTest-462902868 None] Create snapshot completed successfully Nov 02 15:51:32 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-e56a467a-8195-460e-8b21-a55f93fc871e tempest-CinderUnicodeTest-462902868 None] Acquiring lock "cinder-ae80925d-4e89-42e2-b52f-bf0ecca82582-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:32 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-e56a467a-8195-460e-8b21-a55f93fc871e tempest-CinderUnicodeTest-462902868 None] Lock "cinder-ae80925d-4e89-42e2-b52f-bf0ecca82582-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:32 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-e56a467a-8195-460e-8b21-a55f93fc871e tempest-CinderUnicodeTest-462902868 None] Acquiring lock "cinder-quobyte-b269a692-06c9-41ed-8a17-f3c83b42b21c" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:32 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-e56a467a-8195-460e-8b21-a55f93fc871e tempest-CinderUnicodeTest-462902868 None] Lock "cinder-quobyte-b269a692-06c9-41ed-8a17-f3c83b42b21c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:32 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-e56a467a-8195-460e-8b21-a55f93fc871e tempest-CinderUnicodeTest-462902868 None] Acquiring lock "cinder-quobyte-ae80925d-4e89-42e2-b52f-bf0ecca82582" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:32 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-e56a467a-8195-460e-8b21-a55f93fc871e tempest-CinderUnicodeTest-462902868 None] Lock "cinder-quobyte-ae80925d-4e89-42e2-b52f-bf0ecca82582" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-e56a467a-8195-460e-8b21-a55f93fc871e tempest-CinderUnicodeTest-462902868 None] Deleting offline snapshot ae80925d-4e89-42e2-b52f-bf0ecca82582 of volume b269a692-06c9-41ed-8a17-f3c83b42b21c {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:51:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-e56a467a-8195-460e-8b21-a55f93fc871e tempest-CinderUnicodeTest-462902868 None] snapshot_file for this snap is: volume-b269a692-06c9-41ed-8a17-f3c83b42b21c.ae80925d-4e89-42e2-b52f-bf0ecca82582 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:51:32 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d829bf6-b9b5-45f9-83f5-767f5a766e90]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e56a467a-8195-460e-8b21-a55f93fc871e tempest-CinderUnicodeTest-462902868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c.ae80925d-4e89-42e2-b52f-bf0ecca82582 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:32 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c.ae80925d-4e89-42e2-b52f-bf0ecca82582 Nov 02 15:51:32 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:32 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e56a467a-8195-460e-8b21-a55f93fc871e tempest-CinderUnicodeTest-462902868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c.ae80925d-4e89-42e2-b52f-bf0ecca82582" returned: 0 in 0.501s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-e56a467a-8195-460e-8b21-a55f93fc871e tempest-CinderUnicodeTest-462902868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b269a692-06c9-41ed-8a17-f3c83b42b21c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:51:32 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f709f3c-624a-49cc-b317-7c9835f88ffb]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e56a467a-8195-460e-8b21-a55f93fc871e tempest-CinderUnicodeTest-462902868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:33 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c Nov 02 15:51:33 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:33 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e56a467a-8195-460e-8b21-a55f93fc871e tempest-CinderUnicodeTest-462902868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c" returned: 0 in 0.489s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e56a467a-8195-460e-8b21-a55f93fc871e tempest-CinderUnicodeTest-462902868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c.ae80925d-4e89-42e2-b52f-bf0ecca82582 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:33 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c.ae80925d-4e89-42e2-b52f-bf0ecca82582 Nov 02 15:51:33 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:33 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e56a467a-8195-460e-8b21-a55f93fc871e tempest-CinderUnicodeTest-462902868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c.ae80925d-4e89-42e2-b52f-bf0ecca82582" returned: 0 in 0.508s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e56a467a-8195-460e-8b21-a55f93fc871e tempest-CinderUnicodeTest-462902868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c.ae80925d-4e89-42e2-b52f-bf0ecca82582 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:33 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c.ae80925d-4e89-42e2-b52f-bf0ecca82582 Nov 02 15:51:33 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:34 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-e56a467a-8195-460e-8b21-a55f93fc871e tempest-CinderUnicodeTest-462902868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c.ae80925d-4e89-42e2-b52f-bf0ecca82582" returned: 0 in 0.303s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:34 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-e56a467a-8195-460e-8b21-a55f93fc871e tempest-CinderUnicodeTest-462902868 None] Lock "cinder-quobyte-ae80925d-4e89-42e2-b52f-bf0ecca82582" released by "_delete_snapshot" :: held 1.975s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:34 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-e56a467a-8195-460e-8b21-a55f93fc871e tempest-CinderUnicodeTest-462902868 None] Lock "cinder-quobyte-b269a692-06c9-41ed-8a17-f3c83b42b21c" released by "delete_snapshot" :: held 2.011s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:34 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-e56a467a-8195-460e-8b21-a55f93fc871e tempest-CinderUnicodeTest-462902868 None] Created reservations ['18a70f8a-540a-47e5-8e5b-61ac41ec736a', 'b4873c0f-112f-4ae5-b753-d941f501e71c', 'f801ee94-39c6-4f39-9beb-873c4f6bbc30', '3e023970-ea52-4703-bc69-4730bdfd6937'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:51:34 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-e56a467a-8195-460e-8b21-a55f93fc871e tempest-CinderUnicodeTest-462902868 None] Delete snapshot completed successfully. Nov 02 15:51:34 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-e56a467a-8195-460e-8b21-a55f93fc871e tempest-CinderUnicodeTest-462902868 None] Lock "cinder-ae80925d-4e89-42e2-b52f-bf0ecca82582-delete_snapshot" released by "delete_snapshot" :: held 2.241s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c55518b9-1f2b-46e1-9e1a-3615da085c94 tempest-CinderUnicodeTest-462902868 None] Acquiring lock "cinder-b269a692-06c9-41ed-8a17-f3c83b42b21c-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c55518b9-1f2b-46e1-9e1a-3615da085c94 tempest-CinderUnicodeTest-462902868 None] Lock "cinder-b269a692-06c9-41ed-8a17-f3c83b42b21c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c55518b9-1f2b-46e1-9e1a-3615da085c94 tempest-CinderUnicodeTest-462902868 None] Acquiring lock "cinder-quobyte-b269a692-06c9-41ed-8a17-f3c83b42b21c" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:35 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c55518b9-1f2b-46e1-9e1a-3615da085c94 tempest-CinderUnicodeTest-462902868 None] Lock "cinder-quobyte-b269a692-06c9-41ed-8a17-f3c83b42b21c" acquired by "delete_volume" :: waited 0.023s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:35 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[d455f9d0-fc59-404f-8d67-ce03c26f1fb3]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c55518b9-1f2b-46e1-9e1a-3615da085c94 tempest-CinderUnicodeTest-462902868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:35 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c Nov 02 15:51:35 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:36 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c55518b9-1f2b-46e1-9e1a-3615da085c94 tempest-CinderUnicodeTest-462902868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c" returned: 0 in 0.485s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c55518b9-1f2b-46e1-9e1a-3615da085c94 tempest-CinderUnicodeTest-462902868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:36 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c Nov 02 15:51:36 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:36 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c55518b9-1f2b-46e1-9e1a-3615da085c94 tempest-CinderUnicodeTest-462902868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-b269a692-06c9-41ed-8a17-f3c83b42b21c" returned: 0 in 0.278s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c55518b9-1f2b-46e1-9e1a-3615da085c94 tempest-CinderUnicodeTest-462902868 None] Lock "cinder-quobyte-b269a692-06c9-41ed-8a17-f3c83b42b21c" released by "delete_volume" :: held 0.862s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:36 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-c55518b9-1f2b-46e1-9e1a-3615da085c94 tempest-CinderUnicodeTest-462902868 None] Created reservations ['e027bc70-b563-4266-bf56-cef11c62edd7', 'c39927a1-fad7-455c-b70b-280e947f0497', '89be4f9e-6267-4891-a278-ae0a0c08ae0f', '1a788972-4f61-4a37-bd35-a0b94bdadc88'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:51:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c55518b9-1f2b-46e1-9e1a-3615da085c94 tempest-CinderUnicodeTest-462902868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c55518b9-1f2b-46e1-9e1a-3615da085c94 tempest-CinderUnicodeTest-462902868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:36 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c55518b9-1f2b-46e1-9e1a-3615da085c94 tempest-CinderUnicodeTest-462902868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:51:36 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c55518b9-1f2b-46e1-9e1a-3615da085c94 tempest-CinderUnicodeTest-462902868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:51:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c55518b9-1f2b-46e1-9e1a-3615da085c94 tempest-CinderUnicodeTest-462902868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c55518b9-1f2b-46e1-9e1a-3615da085c94 tempest-CinderUnicodeTest-462902868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:36 devstack sudo[107570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:51:36 devstack sudo[107570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6a9f2048-dd11-4078-b7e2-b5dbccbed8e3 tempest-CinderUnicodeTest-462902868 None] Acquiring lock "cinder-fceff2c5-48a5-41e3-992e-33ab1331b9d9-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6a9f2048-dd11-4078-b7e2-b5dbccbed8e3 tempest-CinderUnicodeTest-462902868 None] Lock "cinder-fceff2c5-48a5-41e3-992e-33ab1331b9d9-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6a9f2048-dd11-4078-b7e2-b5dbccbed8e3 tempest-CinderUnicodeTest-462902868 None] Acquiring lock "cinder-quobyte-fceff2c5-48a5-41e3-992e-33ab1331b9d9" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6a9f2048-dd11-4078-b7e2-b5dbccbed8e3 tempest-CinderUnicodeTest-462902868 None] Lock "cinder-quobyte-fceff2c5-48a5-41e3-992e-33ab1331b9d9" acquired by "delete_volume" :: waited 0.017s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:36 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f5ab55-a162-42d0-aa0a-008f9c5a3dbc]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6a9f2048-dd11-4078-b7e2-b5dbccbed8e3 tempest-CinderUnicodeTest-462902868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-fceff2c5-48a5-41e3-992e-33ab1331b9d9 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:37 devstack sudo[107570]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c55518b9-1f2b-46e1-9e1a-3615da085c94 tempest-CinderUnicodeTest-462902868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.359s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:37 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-c55518b9-1f2b-46e1-9e1a-3615da085c94 tempest-CinderUnicodeTest-462902868 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:51:37 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-c55518b9-1f2b-46e1-9e1a-3615da085c94 tempest-CinderUnicodeTest-462902868 None] Deleted volume successfully. Nov 02 15:51:37 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c55518b9-1f2b-46e1-9e1a-3615da085c94 tempest-CinderUnicodeTest-462902868 None] Lock "cinder-b269a692-06c9-41ed-8a17-f3c83b42b21c-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:37 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-fceff2c5-48a5-41e3-992e-33ab1331b9d9 Nov 02 15:51:37 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:37 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6a9f2048-dd11-4078-b7e2-b5dbccbed8e3 tempest-CinderUnicodeTest-462902868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-fceff2c5-48a5-41e3-992e-33ab1331b9d9" returned: 0 in 0.490s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6a9f2048-dd11-4078-b7e2-b5dbccbed8e3 tempest-CinderUnicodeTest-462902868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-fceff2c5-48a5-41e3-992e-33ab1331b9d9 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:37 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-fceff2c5-48a5-41e3-992e-33ab1331b9d9 Nov 02 15:51:37 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:37 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6a9f2048-dd11-4078-b7e2-b5dbccbed8e3 tempest-CinderUnicodeTest-462902868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-fceff2c5-48a5-41e3-992e-33ab1331b9d9" returned: 0 in 0.360s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:37 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6a9f2048-dd11-4078-b7e2-b5dbccbed8e3 tempest-CinderUnicodeTest-462902868 None] Lock "cinder-quobyte-fceff2c5-48a5-41e3-992e-33ab1331b9d9" released by "delete_volume" :: held 0.915s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:37 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-6a9f2048-dd11-4078-b7e2-b5dbccbed8e3 tempest-CinderUnicodeTest-462902868 None] Created reservations ['257135fc-cd9d-4d68-b5b6-db2b36c9655f', '70a04ee2-48e2-4a03-a36c-59a4ab14dc18', '61a608ac-6481-4d9f-82ae-547d953c9a0b', '84c73be8-8960-4602-b1a1-32b81249aeb2'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:51:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-6a9f2048-dd11-4078-b7e2-b5dbccbed8e3 tempest-CinderUnicodeTest-462902868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-6a9f2048-dd11-4078-b7e2-b5dbccbed8e3 tempest-CinderUnicodeTest-462902868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-6a9f2048-dd11-4078-b7e2-b5dbccbed8e3 tempest-CinderUnicodeTest-462902868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:51:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-6a9f2048-dd11-4078-b7e2-b5dbccbed8e3 tempest-CinderUnicodeTest-462902868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:51:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-6a9f2048-dd11-4078-b7e2-b5dbccbed8e3 tempest-CinderUnicodeTest-462902868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6a9f2048-dd11-4078-b7e2-b5dbccbed8e3 tempest-CinderUnicodeTest-462902868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:38 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:51:38 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:38 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6a9f2048-dd11-4078-b7e2-b5dbccbed8e3 tempest-CinderUnicodeTest-462902868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.346s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:38 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-6a9f2048-dd11-4078-b7e2-b5dbccbed8e3 tempest-CinderUnicodeTest-462902868 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:51:38 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-6a9f2048-dd11-4078-b7e2-b5dbccbed8e3 tempest-CinderUnicodeTest-462902868 None] Deleted volume successfully. Nov 02 15:51:38 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6a9f2048-dd11-4078-b7e2-b5dbccbed8e3 tempest-CinderUnicodeTest-462902868 None] Lock "cinder-fceff2c5-48a5-41e3-992e-33ab1331b9d9-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:38 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:51:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] Flow 'volume_create_manager' (9c0471a2-85ed-4069-a692-30b55fe72a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:51:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae2d0916-60fa-4af8-878f-a9176a9f48fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae2d0916-60fa-4af8-878f-a9176a9f48fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-150201230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81907193-049a-445a-879b-03d3cda31cb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476f1290a8fc49aea31ce1be099926b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:51:38Z,use_quota=True,user_id='cc024a2b93f845518c3128a0ee9ab170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65af44ac-23ad-4895-94da-23463ae94c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65af44ac-23ad-4895-94da-23463ae94c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f712d2-1819-445f-a046-2b01b7f60ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f712d2-1819-445f-a046-2b01b7f60ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81907193-049a-445a-879b-03d3cda31cb9', 'volume_name': 'volume-81907193-049a-445a-879b-03d3cda31cb9', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aef9d610-a93a-4f70-864f-6a9edad155c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aef9d610-a93a-4f70-864f-6a9edad155c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:38 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8219553-e71a-4acf-bbb7-3239a3bb96cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:38 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] Volume 81907193-049a-445a-879b-03d3cda31cb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81907193-049a-445a-879b-03d3cda31cb9', 'volume_size': 1} Nov 02 15:51:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-150201230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81907193-049a-445a-879b-03d3cda31cb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476f1290a8fc49aea31ce1be099926b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:51:38Z,use_quota=True,user_id='cc024a2b93f845518c3128a0ee9ab170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:51:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] Creating volume 81907193-049a-445a-879b-03d3cda31cb9 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:51:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:51:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:51:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:38 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:51:38 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:51:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-81907193-049a-445a-879b-03d3cda31cb9 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:38 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-81907193-049a-445a-879b-03d3cda31cb9 1073741824 Nov 02 15:51:38 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:39 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-81907193-049a-445a-879b-03d3cda31cb9 1073741824" returned: 0 in 0.579s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-81907193-049a-445a-879b-03d3cda31cb9 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:39 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-81907193-049a-445a-879b-03d3cda31cb9 Nov 02 15:51:39 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:39 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-81907193-049a-445a-879b-03d3cda31cb9" returned: 0 in 0.291s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:39 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:51:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:39 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8219553-e71a-4acf-bbb7-3239a3bb96cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81907193-049a-445a-879b-03d3cda31cb9', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:39 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb05ffd-6915-481c-b65d-4b36e3884849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:39 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] Volume volume-81907193-049a-445a-879b-03d3cda31cb9 (81907193-049a-445a-879b-03d3cda31cb9): created successfully Nov 02 15:51:39 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdb05ffd-6915-481c-b65d-4b36e3884849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:39 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] Flow 'volume_create_manager' (9c0471a2-85ed-4069-a692-30b55fe72a63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:51:39 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-52ae661a-7a8b-4f8d-b6bd-453d3178fcad tempest-ProjectReaderTests-1113656923 None] Created volume successfully. Nov 02 15:51:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-42a7cc80-3b15-401a-a491-d3be14d2744d tempest-ProjectReaderTests-1113656923 None] Acquiring lock "cinder-81907193-049a-445a-879b-03d3cda31cb9-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-42a7cc80-3b15-401a-a491-d3be14d2744d tempest-ProjectReaderTests-1113656923 None] Lock "cinder-81907193-049a-445a-879b-03d3cda31cb9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-42a7cc80-3b15-401a-a491-d3be14d2744d tempest-ProjectReaderTests-1113656923 None] Acquiring lock "cinder-quobyte-81907193-049a-445a-879b-03d3cda31cb9" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:40 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-42a7cc80-3b15-401a-a491-d3be14d2744d tempest-ProjectReaderTests-1113656923 None] Lock "cinder-quobyte-81907193-049a-445a-879b-03d3cda31cb9" acquired by "delete_volume" :: waited 0.027s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:41 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c003ca-2e7e-4b12-8344-113dca6bc82f]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-42a7cc80-3b15-401a-a491-d3be14d2744d tempest-ProjectReaderTests-1113656923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-81907193-049a-445a-879b-03d3cda31cb9 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:41 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-81907193-049a-445a-879b-03d3cda31cb9 Nov 02 15:51:41 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:41 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-42a7cc80-3b15-401a-a491-d3be14d2744d tempest-ProjectReaderTests-1113656923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-81907193-049a-445a-879b-03d3cda31cb9" returned: 0 in 0.420s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-42a7cc80-3b15-401a-a491-d3be14d2744d tempest-ProjectReaderTests-1113656923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-81907193-049a-445a-879b-03d3cda31cb9 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:41 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-81907193-049a-445a-879b-03d3cda31cb9 Nov 02 15:51:41 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:41 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-42a7cc80-3b15-401a-a491-d3be14d2744d tempest-ProjectReaderTests-1113656923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-81907193-049a-445a-879b-03d3cda31cb9" returned: 0 in 0.260s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:41 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-42a7cc80-3b15-401a-a491-d3be14d2744d tempest-ProjectReaderTests-1113656923 None] Lock "cinder-quobyte-81907193-049a-445a-879b-03d3cda31cb9" released by "delete_volume" :: held 0.746s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:41 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-42a7cc80-3b15-401a-a491-d3be14d2744d tempest-ProjectReaderTests-1113656923 None] Created reservations ['88d41d94-1db2-4281-bbde-d0e86200637b', 'cd66fe1a-faee-4d48-ab66-1554882241fc', 'a24d7a05-b28a-4036-b11d-68d9bca3a356', 'b4be7f22-c041-4a6c-82cf-ad318c0305c7'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:51:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-42a7cc80-3b15-401a-a491-d3be14d2744d tempest-ProjectReaderTests-1113656923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-42a7cc80-3b15-401a-a491-d3be14d2744d tempest-ProjectReaderTests-1113656923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:41 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-42a7cc80-3b15-401a-a491-d3be14d2744d tempest-ProjectReaderTests-1113656923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:51:41 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-42a7cc80-3b15-401a-a491-d3be14d2744d tempest-ProjectReaderTests-1113656923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:51:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-42a7cc80-3b15-401a-a491-d3be14d2744d tempest-ProjectReaderTests-1113656923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-42a7cc80-3b15-401a-a491-d3be14d2744d tempest-ProjectReaderTests-1113656923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:41 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:51:41 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:42 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-42a7cc80-3b15-401a-a491-d3be14d2744d tempest-ProjectReaderTests-1113656923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.311s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:42 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-42a7cc80-3b15-401a-a491-d3be14d2744d tempest-ProjectReaderTests-1113656923 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:51:42 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-42a7cc80-3b15-401a-a491-d3be14d2744d tempest-ProjectReaderTests-1113656923 None] Deleted volume successfully. Nov 02 15:51:42 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-42a7cc80-3b15-401a-a491-d3be14d2744d tempest-ProjectReaderTests-1113656923 None] Lock "cinder-81907193-049a-445a-879b-03d3cda31cb9-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:42 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:51:42 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] Flow 'volume_create_manager' (e775ac08-fe8a-4d50-8920-54e22c4ade62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:51:42 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd11f33e-d282-4812-9295-cab41cc7ad42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:42 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd11f33e-d282-4812-9295-cab41cc7ad42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-584057053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75895d80-8c39-4e0b-93a8-88a17e5186b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476f1290a8fc49aea31ce1be099926b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:51:43Z,use_quota=True,user_id='cc024a2b93f845518c3128a0ee9ab170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:42 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d67bbf8-f839-4b56-ac46-6058c0460f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:42 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d67bbf8-f839-4b56-ac46-6058c0460f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:42 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a4a2eb7-6a45-4fe7-9bae-cdc035c35418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:42 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a4a2eb7-6a45-4fe7-9bae-cdc035c35418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75895d80-8c39-4e0b-93a8-88a17e5186b2', 'volume_name': 'volume-75895d80-8c39-4e0b-93a8-88a17e5186b2', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:42 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f57c9df9-1663-49d5-8953-e4b70644a809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:42 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f57c9df9-1663-49d5-8953-e4b70644a809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:42 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73dee3e0-df68-43f0-8207-478116e2c13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:42 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] Volume 75895d80-8c39-4e0b-93a8-88a17e5186b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75895d80-8c39-4e0b-93a8-88a17e5186b2', 'volume_size': 1} Nov 02 15:51:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:42 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:51:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-584057053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75895d80-8c39-4e0b-93a8-88a17e5186b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476f1290a8fc49aea31ce1be099926b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:51:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:51:43Z,use_quota=True,user_id='cc024a2b93f845518c3128a0ee9ab170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:51:42 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] Creating volume 75895d80-8c39-4e0b-93a8-88a17e5186b2 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:51:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:42 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:51:42 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:51:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:42 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:51:42 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:51:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-75895d80-8c39-4e0b-93a8-88a17e5186b2 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:42 devstack sudo[107605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-75895d80-8c39-4e0b-93a8-88a17e5186b2 1073741824 Nov 02 15:51:42 devstack sudo[107605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:43 devstack sudo[107605]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-75895d80-8c39-4e0b-93a8-88a17e5186b2 1073741824" returned: 0 in 0.497s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-75895d80-8c39-4e0b-93a8-88a17e5186b2 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:43 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-75895d80-8c39-4e0b-93a8-88a17e5186b2 Nov 02 15:51:43 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:43 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-75895d80-8c39-4e0b-93a8-88a17e5186b2" returned: 0 in 0.311s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:51:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:43 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73dee3e0-df68-43f0-8207-478116e2c13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75895d80-8c39-4e0b-93a8-88a17e5186b2', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:43 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91bb68e8-35c8-4033-8b8a-be3e0b7ed3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:43 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] Volume volume-75895d80-8c39-4e0b-93a8-88a17e5186b2 (75895d80-8c39-4e0b-93a8-88a17e5186b2): created successfully Nov 02 15:51:43 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91bb68e8-35c8-4033-8b8a-be3e0b7ed3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:43 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] Flow 'volume_create_manager' (e775ac08-fe8a-4d50-8920-54e22c4ade62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:51:43 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-dc4cfc29-fcb8-44cf-baae-2a261527bb5f tempest-ProjectReaderTests-1113656923 None] Created volume successfully. Nov 02 15:51:44 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c3342a5b-8f74-4edf-81c5-860707e33c2c tempest-ProjectReaderTests-1113656923 None] Acquiring lock "cinder-75895d80-8c39-4e0b-93a8-88a17e5186b2-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:44 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c3342a5b-8f74-4edf-81c5-860707e33c2c tempest-ProjectReaderTests-1113656923 None] Lock "cinder-75895d80-8c39-4e0b-93a8-88a17e5186b2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:44 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c3342a5b-8f74-4edf-81c5-860707e33c2c tempest-ProjectReaderTests-1113656923 None] Acquiring lock "cinder-quobyte-75895d80-8c39-4e0b-93a8-88a17e5186b2" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:44 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c3342a5b-8f74-4edf-81c5-860707e33c2c tempest-ProjectReaderTests-1113656923 None] Lock "cinder-quobyte-75895d80-8c39-4e0b-93a8-88a17e5186b2" acquired by "delete_volume" :: waited 0.028s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:45 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a187d51f-4b94-4afb-809e-cc47ddab0697]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c3342a5b-8f74-4edf-81c5-860707e33c2c tempest-ProjectReaderTests-1113656923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-75895d80-8c39-4e0b-93a8-88a17e5186b2 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:45 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-75895d80-8c39-4e0b-93a8-88a17e5186b2 Nov 02 15:51:45 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:45 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c3342a5b-8f74-4edf-81c5-860707e33c2c tempest-ProjectReaderTests-1113656923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-75895d80-8c39-4e0b-93a8-88a17e5186b2" returned: 0 in 0.390s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c3342a5b-8f74-4edf-81c5-860707e33c2c tempest-ProjectReaderTests-1113656923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-75895d80-8c39-4e0b-93a8-88a17e5186b2 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:45 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-75895d80-8c39-4e0b-93a8-88a17e5186b2 Nov 02 15:51:45 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:45 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c3342a5b-8f74-4edf-81c5-860707e33c2c tempest-ProjectReaderTests-1113656923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-75895d80-8c39-4e0b-93a8-88a17e5186b2" returned: 0 in 0.278s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c3342a5b-8f74-4edf-81c5-860707e33c2c tempest-ProjectReaderTests-1113656923 None] Lock "cinder-quobyte-75895d80-8c39-4e0b-93a8-88a17e5186b2" released by "delete_volume" :: held 0.741s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:45 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-c3342a5b-8f74-4edf-81c5-860707e33c2c tempest-ProjectReaderTests-1113656923 None] Created reservations ['46a05e86-f073-4cc8-9219-6e2d8f5ca4d5', '96f6c4dd-5006-4906-b544-d4c5c58b01b5', '830b7ea9-44c4-4a72-9224-d7bd784548b4', '44b8a4f4-e8a1-4156-82fc-ba2309fc0728'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:51:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c3342a5b-8f74-4edf-81c5-860707e33c2c tempest-ProjectReaderTests-1113656923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c3342a5b-8f74-4edf-81c5-860707e33c2c tempest-ProjectReaderTests-1113656923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:45 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c3342a5b-8f74-4edf-81c5-860707e33c2c tempest-ProjectReaderTests-1113656923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:51:45 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-c3342a5b-8f74-4edf-81c5-860707e33c2c tempest-ProjectReaderTests-1113656923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:51:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-c3342a5b-8f74-4edf-81c5-860707e33c2c tempest-ProjectReaderTests-1113656923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c3342a5b-8f74-4edf-81c5-860707e33c2c tempest-ProjectReaderTests-1113656923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:45 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:51:45 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:46 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-c3342a5b-8f74-4edf-81c5-860707e33c2c tempest-ProjectReaderTests-1113656923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.310s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:46 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-c3342a5b-8f74-4edf-81c5-860707e33c2c tempest-ProjectReaderTests-1113656923 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:51:46 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-c3342a5b-8f74-4edf-81c5-860707e33c2c tempest-ProjectReaderTests-1113656923 None] Deleted volume successfully. Nov 02 15:51:46 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-c3342a5b-8f74-4edf-81c5-860707e33c2c tempest-ProjectReaderTests-1113656923 None] Lock "cinder-75895d80-8c39-4e0b-93a8-88a17e5186b2-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:46 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:51:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] Flow 'volume_create_manager' (1784135d-4ba3-458a-9f73-7f36d0e7ad11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:51:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c26b7543-102d-4af9-98d1-109028ccf6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c26b7543-102d-4af9-98d1-109028ccf6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1522094034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fb0ed24-b9e9-4227-9314-6baeed00e299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476f1290a8fc49aea31ce1be099926b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:51:47Z,use_quota=True,user_id='cc024a2b93f845518c3128a0ee9ab170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c6123a2-f25c-4781-a275-bf671c81e455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c6123a2-f25c-4781-a275-bf671c81e455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1c0793-c8cf-4da5-84ce-2f9d63989ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1c0793-c8cf-4da5-84ce-2f9d63989ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fb0ed24-b9e9-4227-9314-6baeed00e299', 'volume_name': 'volume-6fb0ed24-b9e9-4227-9314-6baeed00e299', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0707f031-7ec0-4f48-b2e6-b47dfd5481c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0707f031-7ec0-4f48-b2e6-b47dfd5481c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:46 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3349b601-a805-43a3-8e76-7e1adb2d3c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:46 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] Volume 6fb0ed24-b9e9-4227-9314-6baeed00e299: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fb0ed24-b9e9-4227-9314-6baeed00e299', 'volume_size': 1} Nov 02 15:51:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:46 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1522094034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fb0ed24-b9e9-4227-9314-6baeed00e299,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476f1290a8fc49aea31ce1be099926b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:51:47Z,use_quota=True,user_id='cc024a2b93f845518c3128a0ee9ab170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:51:46 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] Creating volume 6fb0ed24-b9e9-4227-9314-6baeed00e299 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:51:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:46 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:51:46 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:51:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:46 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:51:46 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:51:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6fb0ed24-b9e9-4227-9314-6baeed00e299 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:46 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6fb0ed24-b9e9-4227-9314-6baeed00e299 1073741824 Nov 02 15:51:46 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:47 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:51:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] Flow 'volume_create_manager' (eb5a0cd4-937c-44a0-889b-a78d906c5299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:51:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df9b6157-59ef-4ab1-84e1-33dcd17144a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df9b6157-59ef-4ab1-84e1-33dcd17144a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-348781273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c31e9c9f-a86a-41a7-9fbc-933a980c1d6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b52f00447124da7bdd3954d3f68d935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:51:47Z,use_quota=True,user_id='5a0e80e52f41462994336772e4eb18fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d0b0509-bad0-4f44-967e-f1a3792948ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d0b0509-bad0-4f44-967e-f1a3792948ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (917e5506-4232-4b20-9de0-9b0d0c0e014d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (917e5506-4232-4b20-9de0-9b0d0c0e014d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c31e9c9f-a86a-41a7-9fbc-933a980c1d6d', 'volume_name': 'volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70bbc72e-752c-4318-93d7-48bbe1e8d4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70bbc72e-752c-4318-93d7-48bbe1e8d4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23611a71-6624-463f-862e-c5cfc4bd9b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:47 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] Volume c31e9c9f-a86a-41a7-9fbc-933a980c1d6d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d', 'volume_size': 1} Nov 02 15:51:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:47 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6fb0ed24-b9e9-4227-9314-6baeed00e299 1073741824" returned: 0 in 0.578s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6fb0ed24-b9e9-4227-9314-6baeed00e299 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:47 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6fb0ed24-b9e9-4227-9314-6baeed00e299 Nov 02 15:51:47 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:47 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6fb0ed24-b9e9-4227-9314-6baeed00e299" returned: 0 in 0.238s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:47 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:51:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.357s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:47 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:51:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-348781273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c31e9c9f-a86a-41a7-9fbc-933a980c1d6d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b52f00447124da7bdd3954d3f68d935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:51:47Z,use_quota=True,user_id='5a0e80e52f41462994336772e4eb18fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:51:47 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] Creating volume c31e9c9f-a86a-41a7-9fbc-933a980c1d6d {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:51:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:47 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:51:47 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:51:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:47 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:51:47 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:51:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3349b601-a805-43a3-8e76-7e1adb2d3c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fb0ed24-b9e9-4227-9314-6baeed00e299', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:47 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d 1073741824 Nov 02 15:51:47 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3967cef-9212-4999-8b8b-c300170075b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:47 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] Volume volume-6fb0ed24-b9e9-4227-9314-6baeed00e299 (6fb0ed24-b9e9-4227-9314-6baeed00e299): created successfully Nov 02 15:51:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3967cef-9212-4999-8b8b-c300170075b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] Flow 'volume_create_manager' (1784135d-4ba3-458a-9f73-7f36d0e7ad11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:51:47 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-46b78954-51e8-4d26-bcd2-30c2c3661a66 tempest-ProjectReaderTests-1113656923 None] Created volume successfully. Nov 02 15:51:48 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d 1073741824" returned: 0 in 0.499s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:48 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d Nov 02 15:51:48 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:48 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d" returned: 0 in 0.242s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:48 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:51:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23611a71-6624-463f-862e-c5cfc4bd9b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d0bbbc9-dd4b-4392-b2ab-07c96a4b849c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:48 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] Volume volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d (c31e9c9f-a86a-41a7-9fbc-933a980c1d6d): created successfully Nov 02 15:51:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d0bbbc9-dd4b-4392-b2ab-07c96a4b849c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:48 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] Flow 'volume_create_manager' (eb5a0cd4-937c-44a0-889b-a78d906c5299) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:51:48 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-f9b7dedb-81a6-4f52-b8dc-d2aab38fd0a5 tempest-ProjectMemberTests-784856624 None] Created volume successfully. Nov 02 15:51:48 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3a1c40e6-c5e3-4601-be9f-c4636b30e25f tempest-ProjectReaderTests-1113656923 None] Acquiring lock "cinder-6fb0ed24-b9e9-4227-9314-6baeed00e299-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:48 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3a1c40e6-c5e3-4601-be9f-c4636b30e25f tempest-ProjectReaderTests-1113656923 None] Lock "cinder-6fb0ed24-b9e9-4227-9314-6baeed00e299-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:48 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3a1c40e6-c5e3-4601-be9f-c4636b30e25f tempest-ProjectReaderTests-1113656923 None] Acquiring lock "cinder-quobyte-6fb0ed24-b9e9-4227-9314-6baeed00e299" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:48 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3a1c40e6-c5e3-4601-be9f-c4636b30e25f tempest-ProjectReaderTests-1113656923 None] Lock "cinder-quobyte-6fb0ed24-b9e9-4227-9314-6baeed00e299" acquired by "delete_volume" :: waited 0.019s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:48 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1df6fbf-0ceb-4587-ab38-04e50403cdbe]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3a1c40e6-c5e3-4601-be9f-c4636b30e25f tempest-ProjectReaderTests-1113656923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6fb0ed24-b9e9-4227-9314-6baeed00e299 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:48 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6fb0ed24-b9e9-4227-9314-6baeed00e299 Nov 02 15:51:48 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:49 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3a1c40e6-c5e3-4601-be9f-c4636b30e25f tempest-ProjectReaderTests-1113656923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6fb0ed24-b9e9-4227-9314-6baeed00e299" returned: 0 in 0.390s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3a1c40e6-c5e3-4601-be9f-c4636b30e25f tempest-ProjectReaderTests-1113656923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6fb0ed24-b9e9-4227-9314-6baeed00e299 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:49 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6fb0ed24-b9e9-4227-9314-6baeed00e299 Nov 02 15:51:49 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:49 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3a1c40e6-c5e3-4601-be9f-c4636b30e25f tempest-ProjectReaderTests-1113656923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-6fb0ed24-b9e9-4227-9314-6baeed00e299" returned: 0 in 0.332s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:49 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3a1c40e6-c5e3-4601-be9f-c4636b30e25f tempest-ProjectReaderTests-1113656923 None] Lock "cinder-quobyte-6fb0ed24-b9e9-4227-9314-6baeed00e299" released by "delete_volume" :: held 0.769s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7d515e71-07bc-400f-9406-3537b88c30af tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7d515e71-07bc-400f-9406-3537b88c30af tempest-ProjectMemberTests-784856624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-7d515e71-07bc-400f-9406-3537b88c30af tempest-ProjectMemberTests-784856624 None] Creating offline snapshot 9726dada-4ce4-4208-a31e-96f670a9bfb1 of volume c31e9c9f-a86a-41a7-9fbc-933a980c1d6d {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:51:49 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb46757-5961-4a0c-9a6b-2dd4d27040dd]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7d515e71-07bc-400f-9406-3537b88c30af tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:49 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-3a1c40e6-c5e3-4601-be9f-c4636b30e25f tempest-ProjectReaderTests-1113656923 None] Created reservations ['34358b4e-a7d5-4544-a435-2c7f5a4b1081', '83fb739d-29f5-4cb8-99be-5746958d3476', '0f603ac6-a876-4068-b96b-e552bfdbaa1f', '623d481e-80da-4d85-a47b-109248fb7794'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:51:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-3a1c40e6-c5e3-4601-be9f-c4636b30e25f tempest-ProjectReaderTests-1113656923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-3a1c40e6-c5e3-4601-be9f-c4636b30e25f tempest-ProjectReaderTests-1113656923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-3a1c40e6-c5e3-4601-be9f-c4636b30e25f tempest-ProjectReaderTests-1113656923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:51:49 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-3a1c40e6-c5e3-4601-be9f-c4636b30e25f tempest-ProjectReaderTests-1113656923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:51:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-3a1c40e6-c5e3-4601-be9f-c4636b30e25f tempest-ProjectReaderTests-1113656923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3a1c40e6-c5e3-4601-be9f-c4636b30e25f tempest-ProjectReaderTests-1113656923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:49 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d Nov 02 15:51:49 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:49 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:51:49 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:50 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:50 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-3a1c40e6-c5e3-4601-be9f-c4636b30e25f tempest-ProjectReaderTests-1113656923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.304s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:50 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-3a1c40e6-c5e3-4601-be9f-c4636b30e25f tempest-ProjectReaderTests-1113656923 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:51:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7d515e71-07bc-400f-9406-3537b88c30af tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d" returned: 0 in 0.422s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7d515e71-07bc-400f-9406-3537b88c30af tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d.9726dada-4ce4-4208-a31e-96f670a9bfb1 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:50 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-3a1c40e6-c5e3-4601-be9f-c4636b30e25f tempest-ProjectReaderTests-1113656923 None] Deleted volume successfully. Nov 02 15:51:50 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d.9726dada-4ce4-4208-a31e-96f670a9bfb1 1G Nov 02 15:51:50 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:50 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-3a1c40e6-c5e3-4601-be9f-c4636b30e25f tempest-ProjectReaderTests-1113656923 None] Lock "cinder-6fb0ed24-b9e9-4227-9314-6baeed00e299-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:50 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:51:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] Flow 'volume_create_manager' (d381e664-41f6-4ea3-a3f9-29370f5f69a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:51:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36173c2f-7bba-413f-a786-a8c15a13c342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36173c2f-7bba-413f-a786-a8c15a13c342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2141010560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f22c930b-1138-49fd-856e-cfbca7ee77ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476f1290a8fc49aea31ce1be099926b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:51:50Z,use_quota=True,user_id='cc024a2b93f845518c3128a0ee9ab170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01b2933-caec-4ad5-ac20-27b5abc8b8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01b2933-caec-4ad5-ac20-27b5abc8b8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33960c73-bb3c-427f-8141-9502c87e2b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33960c73-bb3c-427f-8141-9502c87e2b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f22c930b-1138-49fd-856e-cfbca7ee77ae', 'volume_name': 'volume-f22c930b-1138-49fd-856e-cfbca7ee77ae', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26bd3d11-df36-41e8-8c05-80f2764a2726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26bd3d11-df36-41e8-8c05-80f2764a2726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:50 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14f47e07-c3f2-438f-8a4c-986bf31c37e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:50 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] Volume f22c930b-1138-49fd-856e-cfbca7ee77ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f22c930b-1138-49fd-856e-cfbca7ee77ae', 'volume_size': 1} Nov 02 15:51:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:50 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7d515e71-07bc-400f-9406-3537b88c30af tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d.9726dada-4ce4-4208-a31e-96f670a9bfb1 1G" returned: 0 in 0.486s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7d515e71-07bc-400f-9406-3537b88c30af tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d.9726dada-4ce4-4208-a31e-96f670a9bfb1 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:50 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d.9726dada-4ce4-4208-a31e-96f670a9bfb1 Nov 02 15:51:50 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:50 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7d515e71-07bc-400f-9406-3537b88c30af tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d.9726dada-4ce4-4208-a31e-96f670a9bfb1" returned: 0 in 0.325s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:50 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-7d515e71-07bc-400f-9406-3537b88c30af tempest-ProjectMemberTests-784856624 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d.9726dada-4ce4-4208-a31e-96f670a9bfb1 is being set with open permissions: ugo+rw Nov 02 15:51:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7d515e71-07bc-400f-9406-3537b88c30af tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d.9726dada-4ce4-4208-a31e-96f670a9bfb1 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:50 devstack sudo[107675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d.9726dada-4ce4-4208-a31e-96f670a9bfb1 Nov 02 15:51:50 devstack sudo[107675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:51 devstack sudo[107675]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7d515e71-07bc-400f-9406-3537b88c30af tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d.9726dada-4ce4-4208-a31e-96f670a9bfb1" returned: 0 in 0.295s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7d515e71-07bc-400f-9406-3537b88c30af tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:51 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d.info Nov 02 15:51:51 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:51 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7d515e71-07bc-400f-9406-3537b88c30af tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d.info" returned: 0 in 0.245s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:51 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-7d515e71-07bc-400f-9406-3537b88c30af tempest-ProjectMemberTests-784856624 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d.info is being set with open permissions: ugo+rw Nov 02 15:51:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7d515e71-07bc-400f-9406-3537b88c30af tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:51 devstack sudo[107681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d.info Nov 02 15:51:51 devstack sudo[107681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:51 devstack sudo[107681]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7d515e71-07bc-400f-9406-3537b88c30af tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d.info" returned: 0 in 0.266s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7d515e71-07bc-400f-9406-3537b88c30af tempest-ProjectMemberTests-784856624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.154s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.277s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:51 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:51:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2141010560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f22c930b-1138-49fd-856e-cfbca7ee77ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='476f1290a8fc49aea31ce1be099926b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:51:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:51:50Z,use_quota=True,user_id='cc024a2b93f845518c3128a0ee9ab170',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:51:51 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] Creating volume f22c930b-1138-49fd-856e-cfbca7ee77ae {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:51:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:51 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:51:51 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:51:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:51 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:51:51 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:51:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22c930b-1138-49fd-856e-cfbca7ee77ae 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:51 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22c930b-1138-49fd-856e-cfbca7ee77ae 1073741824 Nov 02 15:51:51 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:51 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-7d515e71-07bc-400f-9406-3537b88c30af tempest-ProjectMemberTests-784856624 None] Create snapshot completed successfully Nov 02 15:51:52 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22c930b-1138-49fd-856e-cfbca7ee77ae 1073741824" returned: 0 in 0.511s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22c930b-1138-49fd-856e-cfbca7ee77ae {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:52 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22c930b-1138-49fd-856e-cfbca7ee77ae Nov 02 15:51:52 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:52 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22c930b-1138-49fd-856e-cfbca7ee77ae" returned: 0 in 0.290s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:52 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:51:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:52 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14f47e07-c3f2-438f-8a4c-986bf31c37e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f22c930b-1138-49fd-856e-cfbca7ee77ae', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:52 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cbe82a6-285e-4129-a975-905aacab2a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:52 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] Volume volume-f22c930b-1138-49fd-856e-cfbca7ee77ae (f22c930b-1138-49fd-856e-cfbca7ee77ae): created successfully Nov 02 15:51:52 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cbe82a6-285e-4129-a975-905aacab2a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:52 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] Flow 'volume_create_manager' (d381e664-41f6-4ea3-a3f9-29370f5f69a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:51:52 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-678f85dc-9743-4aa5-9d91-fa021e857f79 tempest-ProjectReaderTests-1113656923 None] Created volume successfully. Nov 02 15:51:52 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7c5fbe20-927f-46da-bf25-1493bb9dc7df tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-9726dada-4ce4-4208-a31e-96f670a9bfb1-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:52 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7c5fbe20-927f-46da-bf25-1493bb9dc7df tempest-ProjectMemberTests-784856624 None] Lock "cinder-9726dada-4ce4-4208-a31e-96f670a9bfb1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:52 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7c5fbe20-927f-46da-bf25-1493bb9dc7df tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-quobyte-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:52 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7c5fbe20-927f-46da-bf25-1493bb9dc7df tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:52 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7c5fbe20-927f-46da-bf25-1493bb9dc7df tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-quobyte-9726dada-4ce4-4208-a31e-96f670a9bfb1" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:52 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7c5fbe20-927f-46da-bf25-1493bb9dc7df tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-9726dada-4ce4-4208-a31e-96f670a9bfb1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:52 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-7c5fbe20-927f-46da-bf25-1493bb9dc7df tempest-ProjectMemberTests-784856624 None] Deleting offline snapshot 9726dada-4ce4-4208-a31e-96f670a9bfb1 of volume c31e9c9f-a86a-41a7-9fbc-933a980c1d6d {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:51:52 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-7c5fbe20-927f-46da-bf25-1493bb9dc7df tempest-ProjectMemberTests-784856624 None] snapshot_file for this snap is: volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d.9726dada-4ce4-4208-a31e-96f670a9bfb1 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:51:52 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3198777d-25f5-401a-90af-714f78f12828]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7c5fbe20-927f-46da-bf25-1493bb9dc7df tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d.9726dada-4ce4-4208-a31e-96f670a9bfb1 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:53 devstack sudo[107693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d.9726dada-4ce4-4208-a31e-96f670a9bfb1 Nov 02 15:51:53 devstack sudo[107693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:53 devstack sudo[107693]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7c5fbe20-927f-46da-bf25-1493bb9dc7df tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d.9726dada-4ce4-4208-a31e-96f670a9bfb1" returned: 0 in 0.391s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:53 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-7c5fbe20-927f-46da-bf25-1493bb9dc7df tempest-ProjectMemberTests-784856624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:51:53 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1efe5b-2803-4570-b50b-935ee269deeb]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7c5fbe20-927f-46da-bf25-1493bb9dc7df tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:53 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d Nov 02 15:51:53 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:53 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ddbf43f2-cd91-4171-b8b3-d20382a2d54e tempest-ProjectReaderTests-1113656923 None] Acquiring lock "cinder-f22c930b-1138-49fd-856e-cfbca7ee77ae-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:53 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ddbf43f2-cd91-4171-b8b3-d20382a2d54e tempest-ProjectReaderTests-1113656923 None] Lock "cinder-f22c930b-1138-49fd-856e-cfbca7ee77ae-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:53 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7c5fbe20-927f-46da-bf25-1493bb9dc7df tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d" returned: 0 in 0.411s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7c5fbe20-927f-46da-bf25-1493bb9dc7df tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d.9726dada-4ce4-4208-a31e-96f670a9bfb1 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:53 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d.9726dada-4ce4-4208-a31e-96f670a9bfb1 Nov 02 15:51:53 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:53 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ddbf43f2-cd91-4171-b8b3-d20382a2d54e tempest-ProjectReaderTests-1113656923 None] Acquiring lock "cinder-quobyte-f22c930b-1138-49fd-856e-cfbca7ee77ae" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:53 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ddbf43f2-cd91-4171-b8b3-d20382a2d54e tempest-ProjectReaderTests-1113656923 None] Lock "cinder-quobyte-f22c930b-1138-49fd-856e-cfbca7ee77ae" acquired by "delete_volume" :: waited 0.017s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:53 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74d1e08-68d7-4bc8-a400-bd915f22e98b]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ddbf43f2-cd91-4171-b8b3-d20382a2d54e tempest-ProjectReaderTests-1113656923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22c930b-1138-49fd-856e-cfbca7ee77ae {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:54 devstack sudo[107706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22c930b-1138-49fd-856e-cfbca7ee77ae Nov 02 15:51:54 devstack sudo[107706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:54 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7c5fbe20-927f-46da-bf25-1493bb9dc7df tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d.9726dada-4ce4-4208-a31e-96f670a9bfb1" returned: 0 in 0.381s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7c5fbe20-927f-46da-bf25-1493bb9dc7df tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d.9726dada-4ce4-4208-a31e-96f670a9bfb1 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:54 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d.9726dada-4ce4-4208-a31e-96f670a9bfb1 Nov 02 15:51:54 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:54 devstack sudo[107706]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ddbf43f2-cd91-4171-b8b3-d20382a2d54e tempest-ProjectReaderTests-1113656923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22c930b-1138-49fd-856e-cfbca7ee77ae" returned: 0 in 0.391s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ddbf43f2-cd91-4171-b8b3-d20382a2d54e tempest-ProjectReaderTests-1113656923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22c930b-1138-49fd-856e-cfbca7ee77ae {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:54 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22c930b-1138-49fd-856e-cfbca7ee77ae Nov 02 15:51:54 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:54 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7c5fbe20-927f-46da-bf25-1493bb9dc7df tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d.9726dada-4ce4-4208-a31e-96f670a9bfb1" returned: 0 in 0.295s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:54 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7c5fbe20-927f-46da-bf25-1493bb9dc7df tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-9726dada-4ce4-4208-a31e-96f670a9bfb1" released by "_delete_snapshot" :: held 1.647s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:54 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7c5fbe20-927f-46da-bf25-1493bb9dc7df tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d" released by "delete_snapshot" :: held 1.677s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:54 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-7c5fbe20-927f-46da-bf25-1493bb9dc7df tempest-ProjectMemberTests-784856624 None] Created reservations ['12292ef8-602f-4c78-bc27-450daca5487c', '8cafd58f-a605-4342-b24b-43417a8464f5', 'adb13386-5cdb-48d5-9234-0416c2eb30f6', 'e9ed2cc3-4016-4ba9-8ab3-2bcad8b63f2a'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:51:54 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ddbf43f2-cd91-4171-b8b3-d20382a2d54e tempest-ProjectReaderTests-1113656923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-f22c930b-1138-49fd-856e-cfbca7ee77ae" returned: 0 in 0.326s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:54 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ddbf43f2-cd91-4171-b8b3-d20382a2d54e tempest-ProjectReaderTests-1113656923 None] Lock "cinder-quobyte-f22c930b-1138-49fd-856e-cfbca7ee77ae" released by "delete_volume" :: held 0.775s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:54 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-7c5fbe20-927f-46da-bf25-1493bb9dc7df tempest-ProjectMemberTests-784856624 None] Delete snapshot completed successfully. Nov 02 15:51:54 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-7c5fbe20-927f-46da-bf25-1493bb9dc7df tempest-ProjectMemberTests-784856624 None] Lock "cinder-9726dada-4ce4-4208-a31e-96f670a9bfb1-delete_snapshot" released by "delete_snapshot" :: held 1.918s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:54 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-ddbf43f2-cd91-4171-b8b3-d20382a2d54e tempest-ProjectReaderTests-1113656923 None] Created reservations ['de1d07d0-4367-42b3-ad6a-20850f59c8bf', '7c958951-79cc-436a-a43b-265c9318ff24', 'b0bbb5d5-b14d-48ea-86d0-31c907610b4b', '056215fc-d417-428b-9cc0-d4f39aa00c90'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:51:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ddbf43f2-cd91-4171-b8b3-d20382a2d54e tempest-ProjectReaderTests-1113656923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ddbf43f2-cd91-4171-b8b3-d20382a2d54e tempest-ProjectReaderTests-1113656923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:54 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ddbf43f2-cd91-4171-b8b3-d20382a2d54e tempest-ProjectReaderTests-1113656923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:51:54 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-ddbf43f2-cd91-4171-b8b3-d20382a2d54e tempest-ProjectReaderTests-1113656923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:51:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-ddbf43f2-cd91-4171-b8b3-d20382a2d54e tempest-ProjectReaderTests-1113656923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ddbf43f2-cd91-4171-b8b3-d20382a2d54e tempest-ProjectReaderTests-1113656923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:54 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:51:54 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:55 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-748e1cc6-e378-4d82-9719-65c1c94b8539 tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:55 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-748e1cc6-e378-4d82-9719-65c1c94b8539 tempest-ProjectMemberTests-784856624 None] Lock "cinder-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:55 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-ddbf43f2-cd91-4171-b8b3-d20382a2d54e tempest-ProjectReaderTests-1113656923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.357s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:55 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-ddbf43f2-cd91-4171-b8b3-d20382a2d54e tempest-ProjectReaderTests-1113656923 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:51:55 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-748e1cc6-e378-4d82-9719-65c1c94b8539 tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-quobyte-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:51:55 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-ddbf43f2-cd91-4171-b8b3-d20382a2d54e tempest-ProjectReaderTests-1113656923 None] Deleted volume successfully. Nov 02 15:51:55 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-748e1cc6-e378-4d82-9719-65c1c94b8539 tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d" acquired by "delete_volume" :: waited 0.046s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:51:55 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-ddbf43f2-cd91-4171-b8b3-d20382a2d54e tempest-ProjectReaderTests-1113656923 None] Lock "cinder-f22c930b-1138-49fd-856e-cfbca7ee77ae-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:55 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d62e7b-cc4b-4fa5-a552-17b9a4d8cfee]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-748e1cc6-e378-4d82-9719-65c1c94b8539 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:55 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d Nov 02 15:51:55 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:55 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-748e1cc6-e378-4d82-9719-65c1c94b8539 tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d" returned: 0 in 0.520s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-748e1cc6-e378-4d82-9719-65c1c94b8539 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:55 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d Nov 02 15:51:55 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:56 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-748e1cc6-e378-4d82-9719-65c1c94b8539 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d" returned: 0 in 0.267s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-748e1cc6-e378-4d82-9719-65c1c94b8539 tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d" released by "delete_volume" :: held 0.905s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-748e1cc6-e378-4d82-9719-65c1c94b8539 tempest-ProjectMemberTests-784856624 None] Created reservations ['59eebaf8-3b27-4c09-bc90-035a65d9c068', 'e79f9cbe-0d4d-4287-977a-0552cb22a714', '421af17c-1aa1-474b-bfc9-67c313225c48', 'c1be942c-e217-4bcc-af13-7b82f171937f'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-748e1cc6-e378-4d82-9719-65c1c94b8539 tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-748e1cc6-e378-4d82-9719-65c1c94b8539 tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-748e1cc6-e378-4d82-9719-65c1c94b8539 tempest-ProjectMemberTests-784856624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-748e1cc6-e378-4d82-9719-65c1c94b8539 tempest-ProjectMemberTests-784856624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-748e1cc6-e378-4d82-9719-65c1c94b8539 tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-748e1cc6-e378-4d82-9719-65c1c94b8539 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:56 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:51:56 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:56 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-748e1cc6-e378-4d82-9719-65c1c94b8539 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.292s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-748e1cc6-e378-4d82-9719-65c1c94b8539 tempest-ProjectMemberTests-784856624 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:51:56 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-748e1cc6-e378-4d82-9719-65c1c94b8539 tempest-ProjectMemberTests-784856624 None] Deleted volume successfully. Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-748e1cc6-e378-4d82-9719-65c1c94b8539 tempest-ProjectMemberTests-784856624 None] Lock "cinder-c31e9c9f-a86a-41a7-9fbc-933a980c1d6d-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] Flow 'volume_create_manager' (904affcc-cd98-4fb0-9364-28bcf5940508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c333a426-77a3-49fb-8c55-1feedf814daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c333a426-77a3-49fb-8c55-1feedf814daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-162433634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4fceb50-cf79-4bd2-9ef3-2fa01766bd78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37664fe0357b4290b88044e82093334d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:51:57Z,use_quota=True,user_id='76cee02ffdec4500912afe752807c995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8b89be-f71f-4cef-b446-ab22b7da0da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a8b89be-f71f-4cef-b446-ab22b7da0da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3652aee9-4d0d-4f94-a68d-2b9b35952014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3652aee9-4d0d-4f94-a68d-2b9b35952014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4fceb50-cf79-4bd2-9ef3-2fa01766bd78', 'volume_name': 'volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d26ec6b8-a47f-40b4-9e84-09eb83901736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d26ec6b8-a47f-40b4-9e84-09eb83901736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ff5b59-c10e-4c41-8ca5-57a3be6cf686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:56 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] Volume d4fceb50-cf79-4bd2-9ef3-2fa01766bd78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78', 'volume_size': 1} Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-162433634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4fceb50-cf79-4bd2-9ef3-2fa01766bd78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37664fe0357b4290b88044e82093334d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:51:57Z,use_quota=True,user_id='76cee02ffdec4500912afe752807c995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] Creating volume d4fceb50-cf79-4bd2-9ef3-2fa01766bd78 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:51:56 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:51:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:56 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78 1073741824 Nov 02 15:51:56 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:57 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78 1073741824" returned: 0 in 0.441s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:57 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78 Nov 02 15:51:57 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:57 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78" returned: 0 in 0.250s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:51:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ff5b59-c10e-4c41-8ca5-57a3be6cf686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f69365fb-283a-4a6b-aee6-c1976a16745b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:57 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] Volume volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78 (d4fceb50-cf79-4bd2-9ef3-2fa01766bd78): created successfully Nov 02 15:51:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f69365fb-283a-4a6b-aee6-c1976a16745b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] Flow 'volume_create_manager' (904affcc-cd98-4fb0-9364-28bcf5940508) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:51:57 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-95031d31-e572-4dfa-90e0-3ac6255b6ef7 tempest-SnapshotDependencyTests-804074798 None] Created volume successfully. Nov 02 15:51:57 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:51:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] Flow 'volume_create_manager' (e96d6aa0-6819-4ad3-a388-c8b36c84c84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:51:57 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24815b5a-0e92-4ae4-afa5-95bd9237e3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24815b5a-0e92-4ae4-afa5-95bd9237e3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1775436905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=374e34a2-2d3d-4e0b-8ffe-e20125292683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b52f00447124da7bdd3954d3f68d935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:51:58Z,use_quota=True,user_id='5a0e80e52f41462994336772e4eb18fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1221876-2d6a-49d1-bc43-6407c7bc3cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1221876-2d6a-49d1-bc43-6407c7bc3cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d9d969-ccea-4761-935d-3d946bd29939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d9d969-ccea-4761-935d-3d946bd29939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '374e34a2-2d3d-4e0b-8ffe-e20125292683', 'volume_name': 'volume-374e34a2-2d3d-4e0b-8ffe-e20125292683', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (651c4816-9813-4af6-a865-14e0d27ff51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (651c4816-9813-4af6-a865-14e0d27ff51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a009ce74-c1c2-4b5c-a2df-1bb61d9ff572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:58 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] Volume 374e34a2-2d3d-4e0b-8ffe-e20125292683: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-374e34a2-2d3d-4e0b-8ffe-e20125292683', 'volume_size': 1} Nov 02 15:51:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:58 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1775436905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=374e34a2-2d3d-4e0b-8ffe-e20125292683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b52f00447124da7bdd3954d3f68d935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:51:58Z,use_quota=True,user_id='5a0e80e52f41462994336772e4eb18fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:51:58 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] Creating volume 374e34a2-2d3d-4e0b-8ffe-e20125292683 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:51:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:58 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:51:58 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:51:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:58 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:51:58 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:51:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:58 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683 1073741824 Nov 02 15:51:58 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:58 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683 1073741824" returned: 0 in 0.400s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:58 devstack sudo[107750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683 Nov 02 15:51:58 devstack sudo[107750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:58 devstack sudo[107750]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683" returned: 0 in 0.223s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:58 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] <== create_volume: return (669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:51:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.671s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:51:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a009ce74-c1c2-4b5c-a2df-1bb61d9ff572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-374e34a2-2d3d-4e0b-8ffe-e20125292683', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (058653eb-8096-4721-862f-e0ab239f47b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:51:58 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] Volume volume-374e34a2-2d3d-4e0b-8ffe-e20125292683 (374e34a2-2d3d-4e0b-8ffe-e20125292683): created successfully Nov 02 15:51:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (058653eb-8096-4721-862f-e0ab239f47b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:51:58 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] Flow 'volume_create_manager' (e96d6aa0-6819-4ad3-a388-c8b36c84c84b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:51:58 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-f2418b44-1d8d-4880-893a-87af7a81efce tempest-ProjectMemberTests-784856624 None] Created volume successfully. Nov 02 15:51:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-47a632b1-fbed-46da-8cf2-570a8d8e6e1a tempest-SnapshotDependencyTests-804074798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-47a632b1-fbed-46da-8cf2-570a8d8e6e1a tempest-SnapshotDependencyTests-804074798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:51:59 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-47a632b1-fbed-46da-8cf2-570a8d8e6e1a tempest-SnapshotDependencyTests-804074798 None] Creating offline snapshot 49d780df-7777-475f-9e99-5f62f7fe2a1d of volume d4fceb50-cf79-4bd2-9ef3-2fa01766bd78 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:51:59 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94f9f62-741b-4b9d-a0d1-ca15e2fb0fb0]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:51:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-47a632b1-fbed-46da-8cf2-570a8d8e6e1a tempest-SnapshotDependencyTests-804074798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7dc2b495-57cc-483d-898b-2439c5b321af tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:51:59 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78 Nov 02 15:51:59 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:59 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-47a632b1-fbed-46da-8cf2-570a8d8e6e1a tempest-SnapshotDependencyTests-804074798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78" returned: 0 in 0.349s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-47a632b1-fbed-46da-8cf2-570a8d8e6e1a tempest-SnapshotDependencyTests-804074798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78.49d780df-7777-475f-9e99-5f62f7fe2a1d 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:59 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78.49d780df-7777-475f-9e99-5f62f7fe2a1d 1G Nov 02 15:51:59 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:51:59 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Nov 02 15:51:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-47a632b1-fbed-46da-8cf2-570a8d8e6e1a tempest-SnapshotDependencyTests-804074798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78.49d780df-7777-475f-9e99-5f62f7fe2a1d 1G" returned: 0 in 0.391s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:51:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-47a632b1-fbed-46da-8cf2-570a8d8e6e1a tempest-SnapshotDependencyTests-804074798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78.49d780df-7777-475f-9e99-5f62f7fe2a1d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:51:59 devstack sudo[107764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78.49d780df-7777-475f-9e99-5f62f7fe2a1d Nov 02 15:51:59 devstack sudo[107764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:00 devstack sudo[107764]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-47a632b1-fbed-46da-8cf2-570a8d8e6e1a tempest-SnapshotDependencyTests-804074798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78.49d780df-7777-475f-9e99-5f62f7fe2a1d" returned: 0 in 0.263s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:00 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-47a632b1-fbed-46da-8cf2-570a8d8e6e1a tempest-SnapshotDependencyTests-804074798 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78.49d780df-7777-475f-9e99-5f62f7fe2a1d is being set with open permissions: ugo+rw Nov 02 15:52:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-47a632b1-fbed-46da-8cf2-570a8d8e6e1a tempest-SnapshotDependencyTests-804074798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78.49d780df-7777-475f-9e99-5f62f7fe2a1d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:00 devstack sudo[107769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78.49d780df-7777-475f-9e99-5f62f7fe2a1d Nov 02 15:52:00 devstack sudo[107769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:00 devstack sudo[107769]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-47a632b1-fbed-46da-8cf2-570a8d8e6e1a tempest-SnapshotDependencyTests-804074798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78.49d780df-7777-475f-9e99-5f62f7fe2a1d" returned: 0 in 0.229s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-47a632b1-fbed-46da-8cf2-570a8d8e6e1a tempest-SnapshotDependencyTests-804074798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:00 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78.info Nov 02 15:52:00 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:00 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-47a632b1-fbed-46da-8cf2-570a8d8e6e1a tempest-SnapshotDependencyTests-804074798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78.info" returned: 0 in 0.237s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:00 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-47a632b1-fbed-46da-8cf2-570a8d8e6e1a tempest-SnapshotDependencyTests-804074798 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78.info is being set with open permissions: ugo+rw Nov 02 15:52:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-47a632b1-fbed-46da-8cf2-570a8d8e6e1a tempest-SnapshotDependencyTests-804074798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:00 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78.info Nov 02 15:52:00 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:00 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-47a632b1-fbed-46da-8cf2-570a8d8e6e1a tempest-SnapshotDependencyTests-804074798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78.info" returned: 0 in 0.233s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-47a632b1-fbed-46da-8cf2-570a8d8e6e1a tempest-SnapshotDependencyTests-804074798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.845s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7dc2b495-57cc-483d-898b-2439c5b321af tempest-ProjectMemberTests-784856624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.737s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:00 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-7dc2b495-57cc-483d-898b-2439c5b321af tempest-ProjectMemberTests-784856624 None] Creating offline snapshot b92718ed-990c-486a-84d2-792558ed44b2 of volume 374e34a2-2d3d-4e0b-8ffe-e20125292683 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:52:00 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-47a632b1-fbed-46da-8cf2-570a8d8e6e1a tempest-SnapshotDependencyTests-804074798 None] Create snapshot completed successfully Nov 02 15:52:00 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dadd53d-708d-4214-bc87-9acd93060208]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7dc2b495-57cc-483d-898b-2439c5b321af tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:01 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683 Nov 02 15:52:01 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:01 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7dc2b495-57cc-483d-898b-2439c5b321af tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683" returned: 0 in 0.354s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7dc2b495-57cc-483d-898b-2439c5b321af tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683.b92718ed-990c-486a-84d2-792558ed44b2 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:01 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683.b92718ed-990c-486a-84d2-792558ed44b2 1G Nov 02 15:52:01 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:01 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7dc2b495-57cc-483d-898b-2439c5b321af tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683.b92718ed-990c-486a-84d2-792558ed44b2 1G" returned: 0 in 0.397s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:01 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7dc2b495-57cc-483d-898b-2439c5b321af tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-374e34a2-2d3d-4e0b-8ffe-e20125292683 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683.b92718ed-990c-486a-84d2-792558ed44b2 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:01 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-374e34a2-2d3d-4e0b-8ffe-e20125292683 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683.b92718ed-990c-486a-84d2-792558ed44b2 Nov 02 15:52:01 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:01 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:52:01 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Flow 'volume_create_manager' (901a1ff7-180e-4b50-b726-e9b0fe4b9ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20575470-2013-489a-9878-206a1a904a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20575470-2013-489a-9878-206a1a904a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:52:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47734af0-2daf-4812-bf4b-7e59b7c0ed04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37664fe0357b4290b88044e82093334d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:52:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=49d780df-7777-475f-9e99-5f62f7fe2a1d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:52:02Z,use_quota=True,user_id='76cee02ffdec4500912afe752807c995',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92aee93-c7c0-423c-a04d-abc5b44086de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a92aee93-c7c0-423c-a04d-abc5b44086de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:02 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (113825a0-f63b-4ba2-bcc5-03d4b42b446a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (113825a0-f63b-4ba2-bcc5-03d4b42b446a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '47734af0-2daf-4812-bf4b-7e59b7c0ed04', 'volume_name': 'volume-47734af0-2daf-4812-bf4b-7e59b7c0ed04', 'volume_size': 1, 'snapshot_id': '49d780df-7777-475f-9e99-5f62f7fe2a1d'}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce6afc7-20bd-4742-8fdf-29f01a297370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce6afc7-20bd-4742-8fdf-29f01a297370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e78f50f-479d-4a06-8c96-877a99c5be29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:02 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Volume 47734af0-2daf-4812-bf4b-7e59b7c0ed04: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-47734af0-2daf-4812-bf4b-7e59b7c0ed04', 'volume_size': 1, 'snapshot_id': '49d780df-7777-475f-9e99-5f62f7fe2a1d'} Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7dc2b495-57cc-483d-898b-2439c5b321af tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-374e34a2-2d3d-4e0b-8ffe-e20125292683 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683.b92718ed-990c-486a-84d2-792558ed44b2" returned: 0 in 0.332s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:02 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-7dc2b495-57cc-483d-898b-2439c5b321af tempest-ProjectMemberTests-784856624 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683.b92718ed-990c-486a-84d2-792558ed44b2 is being set with open permissions: ugo+rw Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7dc2b495-57cc-483d-898b-2439c5b321af tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683.b92718ed-990c-486a-84d2-792558ed44b2 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:02 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683.b92718ed-990c-486a-84d2-792558ed44b2 Nov 02 15:52:02 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:02 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7dc2b495-57cc-483d-898b-2439c5b321af tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683.b92718ed-990c-486a-84d2-792558ed44b2" returned: 0 in 0.228s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7dc2b495-57cc-483d-898b-2439c5b321af tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:02 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683.info Nov 02 15:52:02 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:02 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7dc2b495-57cc-483d-898b-2439c5b321af tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683.info" returned: 0 in 0.245s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:02 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-7dc2b495-57cc-483d-898b-2439c5b321af tempest-ProjectMemberTests-784856624 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683.info is being set with open permissions: ugo+rw Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7dc2b495-57cc-483d-898b-2439c5b321af tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:02 devstack sudo[107837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683.info Nov 02 15:52:02 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:02 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-7dc2b495-57cc-483d-898b-2439c5b321af tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683.info" returned: 0 in 0.229s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-7dc2b495-57cc-483d-898b-2439c5b321af tempest-ProjectMemberTests-784856624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.866s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.729s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Acquiring lock "cinder-quobyte-49d780df-7777-475f-9e99-5f62f7fe2a1d-47734af0-2daf-4812-bf4b-7e59b7c0ed04" by "_create_volume_from_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Lock "cinder-quobyte-49d780df-7777-475f-9e99-5f62f7fe2a1d-47734af0-2daf-4812-bf4b-7e59b7c0ed04" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Creating volume 47734af0-2daf-4812-bf4b-7e59b7c0ed04 from snapshot 49d780df-7777-475f-9e99-5f62f7fe2a1d {{(pid=86703) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Acquiring lock "cinder-quobyte-47734af0-2daf-4812-bf4b-7e59b7c0ed04" by "_copy_volume_from_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:02 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-7dc2b495-57cc-483d-898b-2439c5b321af tempest-ProjectMemberTests-784856624 None] Create snapshot completed successfully Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Lock "cinder-quobyte-47734af0-2daf-4812-bf4b-7e59b7c0ed04" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] snapshot: 49d780df-7777-475f-9e99-5f62f7fe2a1d, volume: 47734af0-2daf-4812-bf4b-7e59b7c0ed04, {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13743a5-fc79-421a-8aa5-b2b42ce514c7]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:02 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78.49d780df-7777-475f-9e99-5f62f7fe2a1d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:03 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78.49d780df-7777-475f-9e99-5f62f7fe2a1d Nov 02 15:52:03 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:03 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78.49d780df-7777-475f-9e99-5f62f7fe2a1d" returned: 0 in 0.336s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:03 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:52:03 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[6007b4d4-e594-4057-9e3a-7c9a90ef8971]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-432eb8d7-8751-4b73-aeba-cc9386748d50 tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-b92718ed-990c-486a-84d2-792558ed44b2-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:03 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78 Nov 02 15:52:03 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-432eb8d7-8751-4b73-aeba-cc9386748d50 tempest-ProjectMemberTests-784856624 None] Lock "cinder-b92718ed-990c-486a-84d2-792558ed44b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-432eb8d7-8751-4b73-aeba-cc9386748d50 tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-quobyte-374e34a2-2d3d-4e0b-8ffe-e20125292683" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-432eb8d7-8751-4b73-aeba-cc9386748d50 tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-374e34a2-2d3d-4e0b-8ffe-e20125292683" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-432eb8d7-8751-4b73-aeba-cc9386748d50 tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-quobyte-b92718ed-990c-486a-84d2-792558ed44b2" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:03 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-432eb8d7-8751-4b73-aeba-cc9386748d50 tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-b92718ed-990c-486a-84d2-792558ed44b2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:03 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-432eb8d7-8751-4b73-aeba-cc9386748d50 tempest-ProjectMemberTests-784856624 None] Deleting offline snapshot b92718ed-990c-486a-84d2-792558ed44b2 of volume 374e34a2-2d3d-4e0b-8ffe-e20125292683 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:52:03 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-432eb8d7-8751-4b73-aeba-cc9386748d50 tempest-ProjectMemberTests-784856624 None] snapshot_file for this snap is: volume-374e34a2-2d3d-4e0b-8ffe-e20125292683.b92718ed-990c-486a-84d2-792558ed44b2 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:52:03 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5efa819-87f2-4abd-ba4d-08acf3bbd76d]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-432eb8d7-8751-4b73-aeba-cc9386748d50 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683.b92718ed-990c-486a-84d2-792558ed44b2 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:03 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683.b92718ed-990c-486a-84d2-792558ed44b2 Nov 02 15:52:03 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:03 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78" returned: 0 in 0.372s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:03 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] will copy from snapshot at /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78 {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 02 15:52:03 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Creating direct copy from snapshot {{(pid=86703) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 02 15:52:03 devstack cinder-volume[86703]: DEBUG cinder.utils [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Path /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-47734af0-2daf-4812-bf4b-7e59b7c0ed04 not found in is_blk_device check {{(pid=86703) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 02 15:52:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-47734af0-2daf-4812-bf4b-7e59b7c0ed04 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:03 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-47734af0-2daf-4812-bf4b-7e59b7c0ed04 Nov 02 15:52:03 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:03 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-432eb8d7-8751-4b73-aeba-cc9386748d50 tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683.b92718ed-990c-486a-84d2-792558ed44b2" returned: 0 in 0.357s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:03 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-432eb8d7-8751-4b73-aeba-cc9386748d50 tempest-ProjectMemberTests-784856624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-374e34a2-2d3d-4e0b-8ffe-e20125292683(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:52:03 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffc5571-63e0-4a5a-828b-37507b9a74bf]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:03 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-432eb8d7-8751-4b73-aeba-cc9386748d50 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:03 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683 Nov 02 15:52:03 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:04 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-432eb8d7-8751-4b73-aeba-cc9386748d50 tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683" returned: 0 in 0.445s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:04 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-432eb8d7-8751-4b73-aeba-cc9386748d50 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683.b92718ed-990c-486a-84d2-792558ed44b2 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:04 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683.b92718ed-990c-486a-84d2-792558ed44b2 Nov 02 15:52:04 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:05 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-432eb8d7-8751-4b73-aeba-cc9386748d50 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683.b92718ed-990c-486a-84d2-792558ed44b2" returned: 0 in 0.740s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-432eb8d7-8751-4b73-aeba-cc9386748d50 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683.b92718ed-990c-486a-84d2-792558ed44b2 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:05 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683.b92718ed-990c-486a-84d2-792558ed44b2 Nov 02 15:52:05 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:05 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:05 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-432eb8d7-8751-4b73-aeba-cc9386748d50 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683.b92718ed-990c-486a-84d2-792558ed44b2" returned: 0 in 0.358s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:05 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-432eb8d7-8751-4b73-aeba-cc9386748d50 tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-b92718ed-990c-486a-84d2-792558ed44b2" released by "_delete_snapshot" :: held 2.066s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:05 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-432eb8d7-8751-4b73-aeba-cc9386748d50 tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-374e34a2-2d3d-4e0b-8ffe-e20125292683" released by "delete_snapshot" :: held 2.096s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:05 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-432eb8d7-8751-4b73-aeba-cc9386748d50 tempest-ProjectMemberTests-784856624 None] Created reservations ['9c32f0bb-8b3e-4a01-a1fc-67024d263381', '045d01a9-6681-4608-b2ac-81c25541e649', '5990b7a5-2376-460c-a8a6-21e8a89486fd', 'e7c36ceb-66dd-420a-a42d-0e1fb16da6c5'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:52:05 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-432eb8d7-8751-4b73-aeba-cc9386748d50 tempest-ProjectMemberTests-784856624 None] Delete snapshot completed successfully. Nov 02 15:52:05 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-432eb8d7-8751-4b73-aeba-cc9386748d50 tempest-ProjectMemberTests-784856624 None] Lock "cinder-b92718ed-990c-486a-84d2-792558ed44b2-delete_snapshot" released by "delete_snapshot" :: held 2.359s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-935a06a1-eb07-43f6-8288-12db16117436 tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-374e34a2-2d3d-4e0b-8ffe-e20125292683-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-935a06a1-eb07-43f6-8288-12db16117436 tempest-ProjectMemberTests-784856624 None] Lock "cinder-374e34a2-2d3d-4e0b-8ffe-e20125292683-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-935a06a1-eb07-43f6-8288-12db16117436 tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-quobyte-374e34a2-2d3d-4e0b-8ffe-e20125292683" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:06 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-935a06a1-eb07-43f6-8288-12db16117436 tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-374e34a2-2d3d-4e0b-8ffe-e20125292683" acquired by "delete_volume" :: waited 0.023s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:06 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a95b4dc-bbdb-43de-b804-717c125599ee]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:06 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-935a06a1-eb07-43f6-8288-12db16117436 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:07 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683 Nov 02 15:52:07 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:07 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-935a06a1-eb07-43f6-8288-12db16117436 tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683" returned: 0 in 0.526s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-935a06a1-eb07-43f6-8288-12db16117436 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:07 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683 Nov 02 15:52:07 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:07 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:07 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-935a06a1-eb07-43f6-8288-12db16117436 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-374e34a2-2d3d-4e0b-8ffe-e20125292683" returned: 0 in 0.301s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:07 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-935a06a1-eb07-43f6-8288-12db16117436 tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-374e34a2-2d3d-4e0b-8ffe-e20125292683" released by "delete_volume" :: held 0.939s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:07 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-935a06a1-eb07-43f6-8288-12db16117436 tempest-ProjectMemberTests-784856624 None] Created reservations ['3f8adf79-aea6-4117-89ff-8f0952022339', '8c5617da-f1bc-4142-82c6-d0f51e73081e', '509f9e1d-3d04-4776-bf99-a5e298858535', '1dfb9ce1-146f-43ab-9480-23aa31df20e1'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:52:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-935a06a1-eb07-43f6-8288-12db16117436 tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-935a06a1-eb07-43f6-8288-12db16117436 tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:08 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-935a06a1-eb07-43f6-8288-12db16117436 tempest-ProjectMemberTests-784856624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:52:08 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-935a06a1-eb07-43f6-8288-12db16117436 tempest-ProjectMemberTests-784856624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:52:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-935a06a1-eb07-43f6-8288-12db16117436 tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-935a06a1-eb07-43f6-8288-12db16117436 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:08 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:52:08 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:08 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:08 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-935a06a1-eb07-43f6-8288-12db16117436 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.271s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:08 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-935a06a1-eb07-43f6-8288-12db16117436 tempest-ProjectMemberTests-784856624 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:52:08 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-935a06a1-eb07-43f6-8288-12db16117436 tempest-ProjectMemberTests-784856624 None] Deleted volume successfully. Nov 02 15:52:08 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-935a06a1-eb07-43f6-8288-12db16117436 tempest-ProjectMemberTests-784856624 None] Lock "cinder-374e34a2-2d3d-4e0b-8ffe-e20125292683-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:09 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:52:09 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] Flow 'volume_create_manager' (27f6f54d-74f2-415a-a39c-bfa0a4d4a631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:52:09 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (534be3e5-72ce-44ad-9d78-2f1b2e207640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:09 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (534be3e5-72ce-44ad-9d78-2f1b2e207640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2140986458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a0a5a68-b677-4e0f-98fe-c78639780891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b52f00447124da7bdd3954d3f68d935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:52:10Z,use_quota=True,user_id='5a0e80e52f41462994336772e4eb18fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:09 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fdddbd9-ce32-439c-86b3-1f75258dae52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:09 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fdddbd9-ce32-439c-86b3-1f75258dae52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:09 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e63c3cf-49a0-4958-939e-6da59ac1add6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:09 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e63c3cf-49a0-4958-939e-6da59ac1add6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a0a5a68-b677-4e0f-98fe-c78639780891', 'volume_name': 'volume-2a0a5a68-b677-4e0f-98fe-c78639780891', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:09 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fd6ab7a-8969-416e-905e-c55ca7fb2e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:09 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fd6ab7a-8969-416e-905e-c55ca7fb2e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:09 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (216f2584-f9a0-4e52-960c-e516943894e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:09 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] Volume 2a0a5a68-b677-4e0f-98fe-c78639780891: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a0a5a68-b677-4e0f-98fe-c78639780891', 'volume_size': 1} Nov 02 15:52:09 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:10 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-47734af0-2daf-4812-bf4b-7e59b7c0ed04" returned: 0 in 6.369s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:10 devstack cinder-volume[86703]: DEBUG cinder.image.image_utils [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Image conversion details: src /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78, size 1024.00 MB, duration 6.37 sec, destination /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-47734af0-2daf-4812-bf4b-7e59b7c0ed04 {{(pid=86703) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 02 15:52:10 devstack cinder-volume[86703]: INFO cinder.image.image_utils [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Converted 1024.00 MB image at 160.77 MB/s Nov 02 15:52:10 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-47734af0-2daf-4812-bf4b-7e59b7c0ed04 is being set with open permissions: ugo+rw Nov 02 15:52:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-47734af0-2daf-4812-bf4b-7e59b7c0ed04 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:10 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-47734af0-2daf-4812-bf4b-7e59b7c0ed04 Nov 02 15:52:10 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:10 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-47734af0-2daf-4812-bf4b-7e59b7c0ed04" returned: 0 in 0.228s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:10 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Lock "cinder-quobyte-47734af0-2daf-4812-bf4b-7e59b7c0ed04" released by "_copy_volume_from_snapshot" :: held 7.392s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:10 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Lock "cinder-quobyte-49d780df-7777-475f-9e99-5f62f7fe2a1d-47734af0-2daf-4812-bf4b-7e59b7c0ed04" released by "_create_volume_from_snapshot" :: held 7.451s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.473s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.448s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2140986458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a0a5a68-b677-4e0f-98fe-c78639780891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b52f00447124da7bdd3954d3f68d935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:52:10Z,use_quota=True,user_id='5a0e80e52f41462994336772e4eb18fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:52:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] Creating volume 2a0a5a68-b677-4e0f-98fe-c78639780891 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:52:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:52:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:52:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:52:10 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:52:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:10 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891 1073741824 Nov 02 15:52:10 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e78f50f-479d-4a06-8c96-877a99c5be29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47734af0-2daf-4812-bf4b-7e59b7c0ed04', 'volume_size': 1, 'snapshot_id': '49d780df-7777-475f-9e99-5f62f7fe2a1d'}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb343c85-be67-4a11-9082-b19979067c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:10 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Volume volume-47734af0-2daf-4812-bf4b-7e59b7c0ed04 (47734af0-2daf-4812-bf4b-7e59b7c0ed04): created successfully Nov 02 15:52:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb343c85-be67-4a11-9082-b19979067c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:10 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Flow 'volume_create_manager' (901a1ff7-180e-4b50-b726-e9b0fe4b9ab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:52:10 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-4f03d3bd-53a6-4afc-ac0d-1bed833c3af0 tempest-SnapshotDependencyTests-804074798 None] Created volume successfully. Nov 02 15:52:10 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8b479bb6-baa2-41d6-9f38-6e0d7f4349d8 tempest-SnapshotDependencyTests-804074798 None] Acquiring lock "cinder-49d780df-7777-475f-9e99-5f62f7fe2a1d-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:10 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891 1073741824" returned: 0 in 0.425s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:10 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8b479bb6-baa2-41d6-9f38-6e0d7f4349d8 tempest-SnapshotDependencyTests-804074798 None] Lock "cinder-49d780df-7777-475f-9e99-5f62f7fe2a1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:10 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8b479bb6-baa2-41d6-9f38-6e0d7f4349d8 tempest-SnapshotDependencyTests-804074798 None] Acquiring lock "cinder-quobyte-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:10 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8b479bb6-baa2-41d6-9f38-6e0d7f4349d8 tempest-SnapshotDependencyTests-804074798 None] Lock "cinder-quobyte-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:10 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8b479bb6-baa2-41d6-9f38-6e0d7f4349d8 tempest-SnapshotDependencyTests-804074798 None] Acquiring lock "cinder-quobyte-49d780df-7777-475f-9e99-5f62f7fe2a1d" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:10 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8b479bb6-baa2-41d6-9f38-6e0d7f4349d8 tempest-SnapshotDependencyTests-804074798 None] Lock "cinder-quobyte-49d780df-7777-475f-9e99-5f62f7fe2a1d" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-8b479bb6-baa2-41d6-9f38-6e0d7f4349d8 tempest-SnapshotDependencyTests-804074798 None] Deleting offline snapshot 49d780df-7777-475f-9e99-5f62f7fe2a1d of volume d4fceb50-cf79-4bd2-9ef3-2fa01766bd78 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:52:10 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891 Nov 02 15:52:10 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:10 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-8b479bb6-baa2-41d6-9f38-6e0d7f4349d8 tempest-SnapshotDependencyTests-804074798 None] snapshot_file for this snap is: volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78.49d780df-7777-475f-9e99-5f62f7fe2a1d {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:52:10 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e71698-cd54-46c4-b3f0-72a5d93dd209]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:10 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8b479bb6-baa2-41d6-9f38-6e0d7f4349d8 tempest-SnapshotDependencyTests-804074798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78.49d780df-7777-475f-9e99-5f62f7fe2a1d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:10 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78.49d780df-7777-475f-9e99-5f62f7fe2a1d Nov 02 15:52:10 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:11 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891" returned: 0 in 0.238s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:11 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:52:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.727s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (216f2584-f9a0-4e52-960c-e516943894e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a0a5a68-b677-4e0f-98fe-c78639780891', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e27a4c0e-acae-4d9e-836b-3aeccbb625b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:11 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] Volume volume-2a0a5a68-b677-4e0f-98fe-c78639780891 (2a0a5a68-b677-4e0f-98fe-c78639780891): created successfully Nov 02 15:52:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e27a4c0e-acae-4d9e-836b-3aeccbb625b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:11 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] Flow 'volume_create_manager' (27f6f54d-74f2-415a-a39c-bfa0a4d4a631) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:52:11 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-f9d07993-7065-4df7-aa0a-d8c32b7c260e tempest-ProjectMemberTests-784856624 None] Created volume successfully. Nov 02 15:52:11 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8b479bb6-baa2-41d6-9f38-6e0d7f4349d8 tempest-SnapshotDependencyTests-804074798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78.49d780df-7777-475f-9e99-5f62f7fe2a1d" returned: 0 in 0.337s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:11 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-8b479bb6-baa2-41d6-9f38-6e0d7f4349d8 tempest-SnapshotDependencyTests-804074798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:52:11 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[237054d8-722e-4227-8576-94c832b0c05c]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8b479bb6-baa2-41d6-9f38-6e0d7f4349d8 tempest-SnapshotDependencyTests-804074798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:11 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78 Nov 02 15:52:11 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:11 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8b479bb6-baa2-41d6-9f38-6e0d7f4349d8 tempest-SnapshotDependencyTests-804074798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78" returned: 0 in 0.537s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8b479bb6-baa2-41d6-9f38-6e0d7f4349d8 tempest-SnapshotDependencyTests-804074798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78.49d780df-7777-475f-9e99-5f62f7fe2a1d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:11 devstack sudo[107925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78.49d780df-7777-475f-9e99-5f62f7fe2a1d Nov 02 15:52:11 devstack sudo[107925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-52ae93ff-ce20-4150-a03a-fc161173823b tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-52ae93ff-ce20-4150-a03a-fc161173823b tempest-ProjectMemberTests-784856624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:11 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-52ae93ff-ce20-4150-a03a-fc161173823b tempest-ProjectMemberTests-784856624 None] Creating offline snapshot ec9941cd-8bee-4020-8147-e84505bb64fd of volume 2a0a5a68-b677-4e0f-98fe-c78639780891 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:52:11 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[95825390-86ad-407b-98f3-82e872044b29]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:11 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-52ae93ff-ce20-4150-a03a-fc161173823b tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:12 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891 Nov 02 15:52:12 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:12 devstack sudo[107925]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8b479bb6-baa2-41d6-9f38-6e0d7f4349d8 tempest-SnapshotDependencyTests-804074798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78.49d780df-7777-475f-9e99-5f62f7fe2a1d" returned: 0 in 0.364s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8b479bb6-baa2-41d6-9f38-6e0d7f4349d8 tempest-SnapshotDependencyTests-804074798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78.49d780df-7777-475f-9e99-5f62f7fe2a1d {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:12 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78.49d780df-7777-475f-9e99-5f62f7fe2a1d Nov 02 15:52:12 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:12 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-52ae93ff-ce20-4150-a03a-fc161173823b tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891" returned: 0 in 0.367s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-52ae93ff-ce20-4150-a03a-fc161173823b tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891.ec9941cd-8bee-4020-8147-e84505bb64fd 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:12 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:12 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891.ec9941cd-8bee-4020-8147-e84505bb64fd 1G Nov 02 15:52:12 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8b479bb6-baa2-41d6-9f38-6e0d7f4349d8 tempest-SnapshotDependencyTests-804074798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78.49d780df-7777-475f-9e99-5f62f7fe2a1d" returned: 0 in 0.236s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:12 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8b479bb6-baa2-41d6-9f38-6e0d7f4349d8 tempest-SnapshotDependencyTests-804074798 None] Lock "cinder-quobyte-49d780df-7777-475f-9e99-5f62f7fe2a1d" released by "_delete_snapshot" :: held 1.577s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:12 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8b479bb6-baa2-41d6-9f38-6e0d7f4349d8 tempest-SnapshotDependencyTests-804074798 None] Lock "cinder-quobyte-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78" released by "delete_snapshot" :: held 1.607s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:12 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-8b479bb6-baa2-41d6-9f38-6e0d7f4349d8 tempest-SnapshotDependencyTests-804074798 None] Created reservations ['e5835807-d4d0-4b81-985b-595c834e0130', 'edc5d4ca-5e27-4c63-bdd9-34b6dd08c4bc', 'a27cb856-dcda-4f8f-80e3-21ade0bea245', 'ac4a6a1c-c0f0-483e-9c49-16bc0c84bbdf'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:52:12 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-8b479bb6-baa2-41d6-9f38-6e0d7f4349d8 tempest-SnapshotDependencyTests-804074798 None] Delete snapshot completed successfully. Nov 02 15:52:12 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8b479bb6-baa2-41d6-9f38-6e0d7f4349d8 tempest-SnapshotDependencyTests-804074798 None] Lock "cinder-49d780df-7777-475f-9e99-5f62f7fe2a1d-delete_snapshot" released by "delete_snapshot" :: held 1.751s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:12 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-52ae93ff-ce20-4150-a03a-fc161173823b tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891.ec9941cd-8bee-4020-8147-e84505bb64fd 1G" returned: 0 in 0.375s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:12 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-52ae93ff-ce20-4150-a03a-fc161173823b tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a0a5a68-b677-4e0f-98fe-c78639780891 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891.ec9941cd-8bee-4020-8147-e84505bb64fd {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:12 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a0a5a68-b677-4e0f-98fe-c78639780891 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891.ec9941cd-8bee-4020-8147-e84505bb64fd Nov 02 15:52:12 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:12 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d2bf925e-453f-436e-a003-cd19e8a818c7 tempest-SnapshotDependencyTests-804074798 None] Acquiring lock "cinder-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:12 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d2bf925e-453f-436e-a003-cd19e8a818c7 tempest-SnapshotDependencyTests-804074798 None] Lock "cinder-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:12 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d2bf925e-453f-436e-a003-cd19e8a818c7 tempest-SnapshotDependencyTests-804074798 None] Acquiring lock "cinder-quobyte-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:12 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d2bf925e-453f-436e-a003-cd19e8a818c7 tempest-SnapshotDependencyTests-804074798 None] Lock "cinder-quobyte-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78" acquired by "delete_volume" :: waited 0.012s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:12 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-52ae93ff-ce20-4150-a03a-fc161173823b tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a0a5a68-b677-4e0f-98fe-c78639780891 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891.ec9941cd-8bee-4020-8147-e84505bb64fd" returned: 0 in 0.322s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:13 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-52ae93ff-ce20-4150-a03a-fc161173823b tempest-ProjectMemberTests-784856624 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891.ec9941cd-8bee-4020-8147-e84505bb64fd is being set with open permissions: ugo+rw Nov 02 15:52:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-52ae93ff-ce20-4150-a03a-fc161173823b tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891.ec9941cd-8bee-4020-8147-e84505bb64fd {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:13 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcdc378-d102-41f2-a026-49a5c0c8fbb9]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d2bf925e-453f-436e-a003-cd19e8a818c7 tempest-SnapshotDependencyTests-804074798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:13 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891.ec9941cd-8bee-4020-8147-e84505bb64fd Nov 02 15:52:13 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:13 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78 Nov 02 15:52:13 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:13 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-52ae93ff-ce20-4150-a03a-fc161173823b tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891.ec9941cd-8bee-4020-8147-e84505bb64fd" returned: 0 in 0.238s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-52ae93ff-ce20-4150-a03a-fc161173823b tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:13 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891.info Nov 02 15:52:13 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:13 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d2bf925e-453f-436e-a003-cd19e8a818c7 tempest-SnapshotDependencyTests-804074798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78" returned: 0 in 0.355s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d2bf925e-453f-436e-a003-cd19e8a818c7 tempest-SnapshotDependencyTests-804074798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:13 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78 Nov 02 15:52:13 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:13 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-52ae93ff-ce20-4150-a03a-fc161173823b tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891.info" returned: 0 in 0.259s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:13 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-52ae93ff-ce20-4150-a03a-fc161173823b tempest-ProjectMemberTests-784856624 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891.info is being set with open permissions: ugo+rw Nov 02 15:52:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-52ae93ff-ce20-4150-a03a-fc161173823b tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:13 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891.info Nov 02 15:52:13 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:13 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d2bf925e-453f-436e-a003-cd19e8a818c7 tempest-SnapshotDependencyTests-804074798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78" returned: 0 in 0.236s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:13 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d2bf925e-453f-436e-a003-cd19e8a818c7 tempest-SnapshotDependencyTests-804074798 None] Lock "cinder-quobyte-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78" released by "delete_volume" :: held 0.655s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:13 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-d2bf925e-453f-436e-a003-cd19e8a818c7 tempest-SnapshotDependencyTests-804074798 None] Created reservations ['eaf934b7-c4ca-4b4a-8f4b-b1e996dc2386', 'c23481e3-1ff3-48da-acce-b55df181b7e5', 'bdd4670b-b167-4a09-8bc7-e5483cfcb3f8', '3d696ef6-45ad-41b9-a7e6-f147c1b1eb45'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:52:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d2bf925e-453f-436e-a003-cd19e8a818c7 tempest-SnapshotDependencyTests-804074798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d2bf925e-453f-436e-a003-cd19e8a818c7 tempest-SnapshotDependencyTests-804074798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:13 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d2bf925e-453f-436e-a003-cd19e8a818c7 tempest-SnapshotDependencyTests-804074798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:52:13 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-d2bf925e-453f-436e-a003-cd19e8a818c7 tempest-SnapshotDependencyTests-804074798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:52:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-d2bf925e-453f-436e-a003-cd19e8a818c7 tempest-SnapshotDependencyTests-804074798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d2bf925e-453f-436e-a003-cd19e8a818c7 tempest-SnapshotDependencyTests-804074798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:13 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-52ae93ff-ce20-4150-a03a-fc161173823b tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891.info" returned: 0 in 0.262s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:13 devstack sudo[107965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:52:13 devstack sudo[107965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:13 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-52ae93ff-ce20-4150-a03a-fc161173823b tempest-ProjectMemberTests-784856624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.918s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:13 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-52ae93ff-ce20-4150-a03a-fc161173823b tempest-ProjectMemberTests-784856624 None] Create snapshot completed successfully Nov 02 15:52:14 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a5d3ad31-d298-4452-931a-a51ade221b93 tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-ec9941cd-8bee-4020-8147-e84505bb64fd-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:14 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a5d3ad31-d298-4452-931a-a51ade221b93 tempest-ProjectMemberTests-784856624 None] Lock "cinder-ec9941cd-8bee-4020-8147-e84505bb64fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:14 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a5d3ad31-d298-4452-931a-a51ade221b93 tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-quobyte-2a0a5a68-b677-4e0f-98fe-c78639780891" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:14 devstack sudo[107965]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d2bf925e-453f-436e-a003-cd19e8a818c7 tempest-SnapshotDependencyTests-804074798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.267s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:14 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-d2bf925e-453f-436e-a003-cd19e8a818c7 tempest-SnapshotDependencyTests-804074798 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:52:14 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a5d3ad31-d298-4452-931a-a51ade221b93 tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-2a0a5a68-b677-4e0f-98fe-c78639780891" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:14 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a5d3ad31-d298-4452-931a-a51ade221b93 tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-quobyte-ec9941cd-8bee-4020-8147-e84505bb64fd" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:14 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-d2bf925e-453f-436e-a003-cd19e8a818c7 tempest-SnapshotDependencyTests-804074798 None] Deleted volume successfully. Nov 02 15:52:14 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a5d3ad31-d298-4452-931a-a51ade221b93 tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-ec9941cd-8bee-4020-8147-e84505bb64fd" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:14 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-a5d3ad31-d298-4452-931a-a51ade221b93 tempest-ProjectMemberTests-784856624 None] Deleting offline snapshot ec9941cd-8bee-4020-8147-e84505bb64fd of volume 2a0a5a68-b677-4e0f-98fe-c78639780891 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:52:14 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-a5d3ad31-d298-4452-931a-a51ade221b93 tempest-ProjectMemberTests-784856624 None] snapshot_file for this snap is: volume-2a0a5a68-b677-4e0f-98fe-c78639780891.ec9941cd-8bee-4020-8147-e84505bb64fd {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:52:14 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8470fd6d-946a-4087-b60f-63fc693ac038 tempest-SnapshotDependencyTests-804074798 None] Acquiring lock "cinder-47734af0-2daf-4812-bf4b-7e59b7c0ed04-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:14 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d2bf925e-453f-436e-a003-cd19e8a818c7 tempest-SnapshotDependencyTests-804074798 None] Lock "cinder-d4fceb50-cf79-4bd2-9ef3-2fa01766bd78-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:14 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8470fd6d-946a-4087-b60f-63fc693ac038 tempest-SnapshotDependencyTests-804074798 None] Lock "cinder-47734af0-2daf-4812-bf4b-7e59b7c0ed04-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:14 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a920b1d-7f89-4374-b16e-a8d79c3e04cc]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a5d3ad31-d298-4452-931a-a51ade221b93 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891.ec9941cd-8bee-4020-8147-e84505bb64fd {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:14 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8470fd6d-946a-4087-b60f-63fc693ac038 tempest-SnapshotDependencyTests-804074798 None] Acquiring lock "cinder-quobyte-47734af0-2daf-4812-bf4b-7e59b7c0ed04" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:14 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8470fd6d-946a-4087-b60f-63fc693ac038 tempest-SnapshotDependencyTests-804074798 None] Lock "cinder-quobyte-47734af0-2daf-4812-bf4b-7e59b7c0ed04" acquired by "delete_volume" :: waited 0.016s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:14 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39c07dd-b23e-4c7c-a898-48fb3ca9a8e0]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8470fd6d-946a-4087-b60f-63fc693ac038 tempest-SnapshotDependencyTests-804074798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-47734af0-2daf-4812-bf4b-7e59b7c0ed04 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:14 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891.ec9941cd-8bee-4020-8147-e84505bb64fd Nov 02 15:52:14 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:14 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-47734af0-2daf-4812-bf4b-7e59b7c0ed04 Nov 02 15:52:14 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:14 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a5d3ad31-d298-4452-931a-a51ade221b93 tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891.ec9941cd-8bee-4020-8147-e84505bb64fd" returned: 0 in 0.358s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:14 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-a5d3ad31-d298-4452-931a-a51ade221b93 tempest-ProjectMemberTests-784856624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a0a5a68-b677-4e0f-98fe-c78639780891(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:52:14 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[34867e52-1e54-408d-a88e-5866ddd45ffd]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a5d3ad31-d298-4452-931a-a51ade221b93 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:14 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8470fd6d-946a-4087-b60f-63fc693ac038 tempest-SnapshotDependencyTests-804074798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-47734af0-2daf-4812-bf4b-7e59b7c0ed04" returned: 0 in 0.390s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8470fd6d-946a-4087-b60f-63fc693ac038 tempest-SnapshotDependencyTests-804074798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-47734af0-2daf-4812-bf4b-7e59b7c0ed04 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:14 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891 Nov 02 15:52:14 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:14 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-47734af0-2daf-4812-bf4b-7e59b7c0ed04 Nov 02 15:52:14 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:14 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8470fd6d-946a-4087-b60f-63fc693ac038 tempest-SnapshotDependencyTests-804074798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-47734af0-2daf-4812-bf4b-7e59b7c0ed04" returned: 0 in 0.261s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:14 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8470fd6d-946a-4087-b60f-63fc693ac038 tempest-SnapshotDependencyTests-804074798 None] Lock "cinder-quobyte-47734af0-2daf-4812-bf4b-7e59b7c0ed04" released by "delete_volume" :: held 0.697s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:14 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a5d3ad31-d298-4452-931a-a51ade221b93 tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891" returned: 0 in 0.371s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:14 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a5d3ad31-d298-4452-931a-a51ade221b93 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891.ec9941cd-8bee-4020-8147-e84505bb64fd {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:14 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891.ec9941cd-8bee-4020-8147-e84505bb64fd Nov 02 15:52:14 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:14 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-8470fd6d-946a-4087-b60f-63fc693ac038 tempest-SnapshotDependencyTests-804074798 None] Created reservations ['f41f54a8-f33c-4fbf-acf2-0f90d3cc25e4', '3a7f9cbb-5e2b-4e5c-98c1-b4365e2f1d02', '21b169f2-5712-4c44-aeb6-3acbd4f714e7', 'f1ce6609-a562-4478-8fbe-f6517370b1c5'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:52:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8470fd6d-946a-4087-b60f-63fc693ac038 tempest-SnapshotDependencyTests-804074798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8470fd6d-946a-4087-b60f-63fc693ac038 tempest-SnapshotDependencyTests-804074798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:15 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8470fd6d-946a-4087-b60f-63fc693ac038 tempest-SnapshotDependencyTests-804074798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:52:15 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8470fd6d-946a-4087-b60f-63fc693ac038 tempest-SnapshotDependencyTests-804074798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:52:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8470fd6d-946a-4087-b60f-63fc693ac038 tempest-SnapshotDependencyTests-804074798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8470fd6d-946a-4087-b60f-63fc693ac038 tempest-SnapshotDependencyTests-804074798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:15 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:52:15 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:15 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:15 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a5d3ad31-d298-4452-931a-a51ade221b93 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891.ec9941cd-8bee-4020-8147-e84505bb64fd" returned: 0 in 0.400s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a5d3ad31-d298-4452-931a-a51ade221b93 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891.ec9941cd-8bee-4020-8147-e84505bb64fd {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8470fd6d-946a-4087-b60f-63fc693ac038 tempest-SnapshotDependencyTests-804074798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.270s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:15 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-8470fd6d-946a-4087-b60f-63fc693ac038 tempest-SnapshotDependencyTests-804074798 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:52:15 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-8470fd6d-946a-4087-b60f-63fc693ac038 tempest-SnapshotDependencyTests-804074798 None] Deleted volume successfully. Nov 02 15:52:15 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891.ec9941cd-8bee-4020-8147-e84505bb64fd Nov 02 15:52:15 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:15 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-8470fd6d-946a-4087-b60f-63fc693ac038 tempest-SnapshotDependencyTests-804074798 None] Lock "cinder-47734af0-2daf-4812-bf4b-7e59b7c0ed04-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:15 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:15 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a5d3ad31-d298-4452-931a-a51ade221b93 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891.ec9941cd-8bee-4020-8147-e84505bb64fd" returned: 0 in 0.233s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:15 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a5d3ad31-d298-4452-931a-a51ade221b93 tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-ec9941cd-8bee-4020-8147-e84505bb64fd" released by "_delete_snapshot" :: held 1.487s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:15 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a5d3ad31-d298-4452-931a-a51ade221b93 tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-2a0a5a68-b677-4e0f-98fe-c78639780891" released by "delete_snapshot" :: held 1.517s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:15 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-a5d3ad31-d298-4452-931a-a51ade221b93 tempest-ProjectMemberTests-784856624 None] Created reservations ['4ae9fb78-7fa8-445b-ae8d-8a48d9b4f867', 'b1eda702-1216-4a29-8dce-5676fbf3d973', '335aa40b-0c14-42e6-bc7c-62cd85ab092b', '7b90dd15-e9ff-47c4-b7f4-901e438a58d4'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:52:15 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-a5d3ad31-d298-4452-931a-a51ade221b93 tempest-ProjectMemberTests-784856624 None] Delete snapshot completed successfully. Nov 02 15:52:15 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-a5d3ad31-d298-4452-931a-a51ade221b93 tempest-ProjectMemberTests-784856624 None] Lock "cinder-ec9941cd-8bee-4020-8147-e84505bb64fd-delete_snapshot" released by "delete_snapshot" :: held 1.652s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:16 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-005f2dd7-6eb5-46ee-b8f9-616bad1004e7 tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-2a0a5a68-b677-4e0f-98fe-c78639780891-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:16 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-005f2dd7-6eb5-46ee-b8f9-616bad1004e7 tempest-ProjectMemberTests-784856624 None] Lock "cinder-2a0a5a68-b677-4e0f-98fe-c78639780891-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:16 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-005f2dd7-6eb5-46ee-b8f9-616bad1004e7 tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-quobyte-2a0a5a68-b677-4e0f-98fe-c78639780891" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:16 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-005f2dd7-6eb5-46ee-b8f9-616bad1004e7 tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-2a0a5a68-b677-4e0f-98fe-c78639780891" acquired by "delete_volume" :: waited 0.013s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:16 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[69dc8e8a-04fa-4040-827d-03e26e78173b]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-005f2dd7-6eb5-46ee-b8f9-616bad1004e7 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:16 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891 Nov 02 15:52:16 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:16 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-005f2dd7-6eb5-46ee-b8f9-616bad1004e7 tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891" returned: 0 in 0.403s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-005f2dd7-6eb5-46ee-b8f9-616bad1004e7 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:16 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891 Nov 02 15:52:16 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:16 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:16 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-005f2dd7-6eb5-46ee-b8f9-616bad1004e7 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-2a0a5a68-b677-4e0f-98fe-c78639780891" returned: 0 in 0.240s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:16 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-005f2dd7-6eb5-46ee-b8f9-616bad1004e7 tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-2a0a5a68-b677-4e0f-98fe-c78639780891" released by "delete_volume" :: held 0.702s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:17 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-005f2dd7-6eb5-46ee-b8f9-616bad1004e7 tempest-ProjectMemberTests-784856624 None] Created reservations ['1c5f7e9b-26e8-4ce1-adde-89bcb71fb357', 'e0c1632a-ade5-43f3-82cb-08fc88f158f5', '089f9466-d5c7-477c-a508-1f83c35c0692', 'ebf09941-51f4-484d-85a8-aa609c693fde'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:52:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-005f2dd7-6eb5-46ee-b8f9-616bad1004e7 tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-005f2dd7-6eb5-46ee-b8f9-616bad1004e7 tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:17 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-005f2dd7-6eb5-46ee-b8f9-616bad1004e7 tempest-ProjectMemberTests-784856624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:52:17 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-005f2dd7-6eb5-46ee-b8f9-616bad1004e7 tempest-ProjectMemberTests-784856624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:52:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-005f2dd7-6eb5-46ee-b8f9-616bad1004e7 tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-005f2dd7-6eb5-46ee-b8f9-616bad1004e7 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:17 devstack sudo[108006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:52:17 devstack sudo[108006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:17 devstack sudo[108006]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:17 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-005f2dd7-6eb5-46ee-b8f9-616bad1004e7 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.260s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:17 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-005f2dd7-6eb5-46ee-b8f9-616bad1004e7 tempest-ProjectMemberTests-784856624 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:52:17 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-005f2dd7-6eb5-46ee-b8f9-616bad1004e7 tempest-ProjectMemberTests-784856624 None] Deleted volume successfully. Nov 02 15:52:17 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-005f2dd7-6eb5-46ee-b8f9-616bad1004e7 tempest-ProjectMemberTests-784856624 None] Lock "cinder-2a0a5a68-b677-4e0f-98fe-c78639780891-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:17 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=149,cinder:UPDATE=209,cinder:INSERT=70,cinder:DELETE=20 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:52:17 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:INSERT=41,cinder:UPDATE=200,cinder:SELECT=162,cinder:DELETE=16 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:52:17 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:52:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] Flow 'volume_create_manager' (fdec97b6-1724-4c3b-be83-882e9d759381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:52:17 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95792d76-9bd4-4b9e-858b-af10065dc779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95792d76-9bd4-4b9e-858b-af10065dc779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-765220058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d2edba-bd4d-47a1-a87c-fefe831637fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b52f00447124da7bdd3954d3f68d935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:52:18Z,use_quota=True,user_id='5a0e80e52f41462994336772e4eb18fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23e3c33b-300a-4e94-a04e-61e932d510b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23e3c33b-300a-4e94-a04e-61e932d510b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bc9e58b-2093-4ccb-b371-1a0dd431d83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bc9e58b-2093-4ccb-b371-1a0dd431d83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50d2edba-bd4d-47a1-a87c-fefe831637fd', 'volume_name': 'volume-50d2edba-bd4d-47a1-a87c-fefe831637fd', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2cca6f0-2ad1-46df-acd1-31c812d00dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2cca6f0-2ad1-46df-acd1-31c812d00dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0877be93-54ac-4f69-9589-fe2f83e4542f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:18 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] Volume 50d2edba-bd4d-47a1-a87c-fefe831637fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50d2edba-bd4d-47a1-a87c-fefe831637fd', 'volume_size': 1} Nov 02 15:52:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:18 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-765220058',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50d2edba-bd4d-47a1-a87c-fefe831637fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b52f00447124da7bdd3954d3f68d935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:52:18Z,use_quota=True,user_id='5a0e80e52f41462994336772e4eb18fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:52:18 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] Creating volume 50d2edba-bd4d-47a1-a87c-fefe831637fd {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:52:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:18 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:52:18 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:52:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:18 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:52:18 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:52:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:18 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd 1073741824 Nov 02 15:52:18 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:18 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd 1073741824" returned: 0 in 0.437s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:18 devstack sudo[108016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd Nov 02 15:52:18 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:18 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd" returned: 0 in 0.232s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:18 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:52:18 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0877be93-54ac-4f69-9589-fe2f83e4542f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50d2edba-bd4d-47a1-a87c-fefe831637fd', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9570c410-f068-46bc-b1af-466d0e700917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:18 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] Volume volume-50d2edba-bd4d-47a1-a87c-fefe831637fd (50d2edba-bd4d-47a1-a87c-fefe831637fd): created successfully Nov 02 15:52:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9570c410-f068-46bc-b1af-466d0e700917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:18 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] Flow 'volume_create_manager' (fdec97b6-1724-4c3b-be83-882e9d759381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:52:18 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-11abd986-49b8-4dd5-a4dd-335fab3ba0a6 tempest-ProjectMemberTests-784856624 None] Created volume successfully. Nov 02 15:52:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-47a1e205-4bda-46b7-80f6-3dd9151b62df tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-47a1e205-4bda-46b7-80f6-3dd9151b62df tempest-ProjectMemberTests-784856624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:19 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-47a1e205-4bda-46b7-80f6-3dd9151b62df tempest-ProjectMemberTests-784856624 None] Creating offline snapshot fc0680b9-f1d7-46fd-9de5-f218465b9acb of volume 50d2edba-bd4d-47a1-a87c-fefe831637fd {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:52:19 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6876f3a-e2b0-4f7f-a217-4874513754ad]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-47a1e205-4bda-46b7-80f6-3dd9151b62df tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:19 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd Nov 02 15:52:19 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:19 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-47a1e205-4bda-46b7-80f6-3dd9151b62df tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd" returned: 0 in 0.414s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-47a1e205-4bda-46b7-80f6-3dd9151b62df tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd.fc0680b9-f1d7-46fd-9de5-f218465b9acb 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:19 devstack sudo[108024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd.fc0680b9-f1d7-46fd-9de5-f218465b9acb 1G Nov 02 15:52:19 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:19 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-47a1e205-4bda-46b7-80f6-3dd9151b62df tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd.fc0680b9-f1d7-46fd-9de5-f218465b9acb 1G" returned: 0 in 0.457s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:19 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-47a1e205-4bda-46b7-80f6-3dd9151b62df tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50d2edba-bd4d-47a1-a87c-fefe831637fd -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd.fc0680b9-f1d7-46fd-9de5-f218465b9acb {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:20 devstack sudo[108030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50d2edba-bd4d-47a1-a87c-fefe831637fd -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd.fc0680b9-f1d7-46fd-9de5-f218465b9acb Nov 02 15:52:20 devstack sudo[108030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:20 devstack sudo[108030]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-47a1e205-4bda-46b7-80f6-3dd9151b62df tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50d2edba-bd4d-47a1-a87c-fefe831637fd -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd.fc0680b9-f1d7-46fd-9de5-f218465b9acb" returned: 0 in 0.301s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:20 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-47a1e205-4bda-46b7-80f6-3dd9151b62df tempest-ProjectMemberTests-784856624 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd.fc0680b9-f1d7-46fd-9de5-f218465b9acb is being set with open permissions: ugo+rw Nov 02 15:52:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-47a1e205-4bda-46b7-80f6-3dd9151b62df tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd.fc0680b9-f1d7-46fd-9de5-f218465b9acb {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:20 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd.fc0680b9-f1d7-46fd-9de5-f218465b9acb Nov 02 15:52:20 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:20 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-47a1e205-4bda-46b7-80f6-3dd9151b62df tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd.fc0680b9-f1d7-46fd-9de5-f218465b9acb" returned: 0 in 0.284s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-47a1e205-4bda-46b7-80f6-3dd9151b62df tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:20 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd.info Nov 02 15:52:20 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:20 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:52:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:52:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:52:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:20 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:52:20 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:20 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:20 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-47a1e205-4bda-46b7-80f6-3dd9151b62df tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd.info" returned: 0 in 0.307s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:20 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-47a1e205-4bda-46b7-80f6-3dd9151b62df tempest-ProjectMemberTests-784856624 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd.info is being set with open permissions: ugo+rw Nov 02 15:52:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-47a1e205-4bda-46b7-80f6-3dd9151b62df tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.259s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:20 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:52:20 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager._thread_info {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:52:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread count: 29 {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 15:52:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread info: [<_MainThread(MainThread, started 125876361756800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 02 15:52:20 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd.info Nov 02 15:52:20 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:21 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-47a1e205-4bda-46b7-80f6-3dd9151b62df tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd.info" returned: 0 in 0.245s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:21 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-47a1e205-4bda-46b7-80f6-3dd9151b62df tempest-ProjectMemberTests-784856624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.113s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:21 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-47a1e205-4bda-46b7-80f6-3dd9151b62df tempest-ProjectMemberTests-784856624 None] Create snapshot completed successfully Nov 02 15:52:22 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-af3f16d8-e393-4747-8e41-ac04753a3b04 tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-fc0680b9-f1d7-46fd-9de5-f218465b9acb-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:22 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-af3f16d8-e393-4747-8e41-ac04753a3b04 tempest-ProjectMemberTests-784856624 None] Lock "cinder-fc0680b9-f1d7-46fd-9de5-f218465b9acb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:22 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-af3f16d8-e393-4747-8e41-ac04753a3b04 tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-quobyte-50d2edba-bd4d-47a1-a87c-fefe831637fd" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:22 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-af3f16d8-e393-4747-8e41-ac04753a3b04 tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-50d2edba-bd4d-47a1-a87c-fefe831637fd" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:22 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-af3f16d8-e393-4747-8e41-ac04753a3b04 tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-quobyte-fc0680b9-f1d7-46fd-9de5-f218465b9acb" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:22 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-af3f16d8-e393-4747-8e41-ac04753a3b04 tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-fc0680b9-f1d7-46fd-9de5-f218465b9acb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:22 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-af3f16d8-e393-4747-8e41-ac04753a3b04 tempest-ProjectMemberTests-784856624 None] Deleting offline snapshot fc0680b9-f1d7-46fd-9de5-f218465b9acb of volume 50d2edba-bd4d-47a1-a87c-fefe831637fd {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:52:22 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-af3f16d8-e393-4747-8e41-ac04753a3b04 tempest-ProjectMemberTests-784856624 None] snapshot_file for this snap is: volume-50d2edba-bd4d-47a1-a87c-fefe831637fd.fc0680b9-f1d7-46fd-9de5-f218465b9acb {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:52:22 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1892bbe-2461-478d-b5a6-a7ab214954b4]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-af3f16d8-e393-4747-8e41-ac04753a3b04 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd.fc0680b9-f1d7-46fd-9de5-f218465b9acb {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:22 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd.fc0680b9-f1d7-46fd-9de5-f218465b9acb Nov 02 15:52:22 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:22 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-af3f16d8-e393-4747-8e41-ac04753a3b04 tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd.fc0680b9-f1d7-46fd-9de5-f218465b9acb" returned: 0 in 0.383s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:22 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-af3f16d8-e393-4747-8e41-ac04753a3b04 tempest-ProjectMemberTests-784856624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50d2edba-bd4d-47a1-a87c-fefe831637fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:52:22 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4859494-b411-4a5b-9569-30de7c7578c7]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:22 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-af3f16d8-e393-4747-8e41-ac04753a3b04 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:22 devstack sudo[108058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd Nov 02 15:52:22 devstack sudo[108058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:23 devstack sudo[108058]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-af3f16d8-e393-4747-8e41-ac04753a3b04 tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd" returned: 0 in 0.347s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-af3f16d8-e393-4747-8e41-ac04753a3b04 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd.fc0680b9-f1d7-46fd-9de5-f218465b9acb {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:23 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd.fc0680b9-f1d7-46fd-9de5-f218465b9acb Nov 02 15:52:23 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:23 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-af3f16d8-e393-4747-8e41-ac04753a3b04 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd.fc0680b9-f1d7-46fd-9de5-f218465b9acb" returned: 0 in 0.319s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-af3f16d8-e393-4747-8e41-ac04753a3b04 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd.fc0680b9-f1d7-46fd-9de5-f218465b9acb {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:23 devstack sudo[108068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd.fc0680b9-f1d7-46fd-9de5-f218465b9acb Nov 02 15:52:23 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:23 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:23 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-af3f16d8-e393-4747-8e41-ac04753a3b04 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd.fc0680b9-f1d7-46fd-9de5-f218465b9acb" returned: 0 in 0.282s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:23 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-af3f16d8-e393-4747-8e41-ac04753a3b04 tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-fc0680b9-f1d7-46fd-9de5-f218465b9acb" released by "_delete_snapshot" :: held 1.460s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:23 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-af3f16d8-e393-4747-8e41-ac04753a3b04 tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-50d2edba-bd4d-47a1-a87c-fefe831637fd" released by "delete_snapshot" :: held 1.486s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:24 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-af3f16d8-e393-4747-8e41-ac04753a3b04 tempest-ProjectMemberTests-784856624 None] Created reservations ['47d03dea-7156-44d9-abc3-421ab1be6915', '532cdb2b-8ec1-436c-a7d4-185fc9e32fc2', '58c9a3dc-b566-451a-a77f-57585cdeacfc', 'd4188f02-e352-480e-b51b-3414fc9aeebd'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:52:24 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-af3f16d8-e393-4747-8e41-ac04753a3b04 tempest-ProjectMemberTests-784856624 None] Delete snapshot completed successfully. Nov 02 15:52:24 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-af3f16d8-e393-4747-8e41-ac04753a3b04 tempest-ProjectMemberTests-784856624 None] Lock "cinder-fc0680b9-f1d7-46fd-9de5-f218465b9acb-delete_snapshot" released by "delete_snapshot" :: held 1.782s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:24 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-27aedebf-f58b-483f-bc9e-486e9415caae tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-50d2edba-bd4d-47a1-a87c-fefe831637fd-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:24 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-27aedebf-f58b-483f-bc9e-486e9415caae tempest-ProjectMemberTests-784856624 None] Lock "cinder-50d2edba-bd4d-47a1-a87c-fefe831637fd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:24 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-27aedebf-f58b-483f-bc9e-486e9415caae tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-quobyte-50d2edba-bd4d-47a1-a87c-fefe831637fd" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:24 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-27aedebf-f58b-483f-bc9e-486e9415caae tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-50d2edba-bd4d-47a1-a87c-fefe831637fd" acquired by "delete_volume" :: waited 0.026s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:24 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5b78ed-a127-4ac1-9c57-59fe9b28bc9c]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-27aedebf-f58b-483f-bc9e-486e9415caae tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:24 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd Nov 02 15:52:24 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:24 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-27aedebf-f58b-483f-bc9e-486e9415caae tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd" returned: 0 in 0.383s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:24 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-27aedebf-f58b-483f-bc9e-486e9415caae tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:25 devstack sudo[108077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd Nov 02 15:52:25 devstack sudo[108077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:25 devstack sudo[108077]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-27aedebf-f58b-483f-bc9e-486e9415caae tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-50d2edba-bd4d-47a1-a87c-fefe831637fd" returned: 0 in 0.272s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:25 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-27aedebf-f58b-483f-bc9e-486e9415caae tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-50d2edba-bd4d-47a1-a87c-fefe831637fd" released by "delete_volume" :: held 0.734s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:25 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-27aedebf-f58b-483f-bc9e-486e9415caae tempest-ProjectMemberTests-784856624 None] Created reservations ['20a4decb-6ee8-4f29-afff-0f766888cc93', 'f3bb3cfc-372f-45ab-93cf-7fdc52706554', 'ae29ce59-90c5-4259-9e00-0ffb065884ae', 'b17fb37f-fd6a-4eb4-9a38-edf18ab5e67a'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:52:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-27aedebf-f58b-483f-bc9e-486e9415caae tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-27aedebf-f58b-483f-bc9e-486e9415caae tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-27aedebf-f58b-483f-bc9e-486e9415caae tempest-ProjectMemberTests-784856624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:52:25 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-27aedebf-f58b-483f-bc9e-486e9415caae tempest-ProjectMemberTests-784856624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:52:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-27aedebf-f58b-483f-bc9e-486e9415caae tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-27aedebf-f58b-483f-bc9e-486e9415caae tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:25 devstack sudo[108080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:52:25 devstack sudo[108080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:25 devstack sudo[108080]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:25 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-27aedebf-f58b-483f-bc9e-486e9415caae tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.266s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:25 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-27aedebf-f58b-483f-bc9e-486e9415caae tempest-ProjectMemberTests-784856624 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:52:25 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-27aedebf-f58b-483f-bc9e-486e9415caae tempest-ProjectMemberTests-784856624 None] Deleted volume successfully. Nov 02 15:52:25 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-27aedebf-f58b-483f-bc9e-486e9415caae tempest-ProjectMemberTests-784856624 None] Lock "cinder-50d2edba-bd4d-47a1-a87c-fefe831637fd-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:26 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:52:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] Flow 'volume_create_manager' (983005b5-d3cf-48b5-acf0-756e4ca04acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:52:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7698bc77-0626-4cb3-9848-722e276c1f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7698bc77-0626-4cb3-9848-722e276c1f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-961454450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e84caeb-58c6-4dd6-ba21-a3b509d00bd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b52f00447124da7bdd3954d3f68d935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:52:26Z,use_quota=True,user_id='5a0e80e52f41462994336772e4eb18fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d1d5be8-4825-4699-b201-3a3a1cfa687b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d1d5be8-4825-4699-b201-3a3a1cfa687b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (623a7414-4bfc-4b86-81b0-cfb8103049e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (623a7414-4bfc-4b86-81b0-cfb8103049e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e84caeb-58c6-4dd6-ba21-a3b509d00bd0', 'volume_name': 'volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7bfdb2f-cb53-4684-8912-620de40c3d17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7bfdb2f-cb53-4684-8912-620de40c3d17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006b7c3d-cefa-47a2-8c40-c51d7fa56d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:26 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] Volume 5e84caeb-58c6-4dd6-ba21-a3b509d00bd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0', 'volume_size': 1} Nov 02 15:52:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-961454450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e84caeb-58c6-4dd6-ba21-a3b509d00bd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b52f00447124da7bdd3954d3f68d935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:52:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:52:26Z,use_quota=True,user_id='5a0e80e52f41462994336772e4eb18fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:52:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] Creating volume 5e84caeb-58c6-4dd6-ba21-a3b509d00bd0 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:52:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:52:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:52:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:52:26 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:52:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:26 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0 1073741824 Nov 02 15:52:26 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:26 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0 1073741824" returned: 0 in 0.430s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:26 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0 Nov 02 15:52:26 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:26 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0" returned: 0 in 0.243s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:26 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:52:26 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (006b7c3d-cefa-47a2-8c40-c51d7fa56d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e20f00-2537-42f9-9cfc-7ecf275c4b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:26 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] Volume volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0 (5e84caeb-58c6-4dd6-ba21-a3b509d00bd0): created successfully Nov 02 15:52:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46e20f00-2537-42f9-9cfc-7ecf275c4b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:26 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] Flow 'volume_create_manager' (983005b5-d3cf-48b5-acf0-756e4ca04acc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:52:26 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-1f36e7ab-f19b-4ed8-b74c-e9af12a261a5 tempest-ProjectMemberTests-784856624 None] Created volume successfully. Nov 02 15:52:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2aef85bc-6475-431d-8968-5b38332d1a24 tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2aef85bc-6475-431d-8968-5b38332d1a24 tempest-ProjectMemberTests-784856624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:27 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-2aef85bc-6475-431d-8968-5b38332d1a24 tempest-ProjectMemberTests-784856624 None] Creating offline snapshot de313ebf-218c-40ab-809a-129f93e7fc68 of volume 5e84caeb-58c6-4dd6-ba21-a3b509d00bd0 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:52:27 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[111604e7-04b2-4da3-9511-bd03acfe4ff9]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2aef85bc-6475-431d-8968-5b38332d1a24 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:27 devstack sudo[108092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0 Nov 02 15:52:27 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:27 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2aef85bc-6475-431d-8968-5b38332d1a24 tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0" returned: 0 in 0.348s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:27 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2aef85bc-6475-431d-8968-5b38332d1a24 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0.de313ebf-218c-40ab-809a-129f93e7fc68 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:27 devstack sudo[108097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0.de313ebf-218c-40ab-809a-129f93e7fc68 1G Nov 02 15:52:27 devstack sudo[108097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:28 devstack sudo[108097]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2aef85bc-6475-431d-8968-5b38332d1a24 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0.de313ebf-218c-40ab-809a-129f93e7fc68 1G" returned: 0 in 0.373s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2aef85bc-6475-431d-8968-5b38332d1a24 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0.de313ebf-218c-40ab-809a-129f93e7fc68 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:28 devstack sudo[108102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0.de313ebf-218c-40ab-809a-129f93e7fc68 Nov 02 15:52:28 devstack sudo[108102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:28 devstack sudo[108102]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2aef85bc-6475-431d-8968-5b38332d1a24 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0.de313ebf-218c-40ab-809a-129f93e7fc68" returned: 0 in 0.290s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:28 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-2aef85bc-6475-431d-8968-5b38332d1a24 tempest-ProjectMemberTests-784856624 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0.de313ebf-218c-40ab-809a-129f93e7fc68 is being set with open permissions: ugo+rw Nov 02 15:52:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2aef85bc-6475-431d-8968-5b38332d1a24 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0.de313ebf-218c-40ab-809a-129f93e7fc68 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:28 devstack sudo[108107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0.de313ebf-218c-40ab-809a-129f93e7fc68 Nov 02 15:52:28 devstack sudo[108107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:28 devstack sudo[108107]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2aef85bc-6475-431d-8968-5b38332d1a24 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0.de313ebf-218c-40ab-809a-129f93e7fc68" returned: 0 in 0.233s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2aef85bc-6475-431d-8968-5b38332d1a24 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:28 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0.info Nov 02 15:52:28 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:28 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2aef85bc-6475-431d-8968-5b38332d1a24 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0.info" returned: 0 in 0.236s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:28 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-2aef85bc-6475-431d-8968-5b38332d1a24 tempest-ProjectMemberTests-784856624 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0.info is being set with open permissions: ugo+rw Nov 02 15:52:28 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2aef85bc-6475-431d-8968-5b38332d1a24 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:28 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0.info Nov 02 15:52:28 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:29 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-2aef85bc-6475-431d-8968-5b38332d1a24 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0.info" returned: 0 in 0.239s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-2aef85bc-6475-431d-8968-5b38332d1a24 tempest-ProjectMemberTests-784856624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.891s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:29 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-2aef85bc-6475-431d-8968-5b38332d1a24 tempest-ProjectMemberTests-784856624 None] Create snapshot completed successfully Nov 02 15:52:29 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b831fb5f-ba67-42da-ac25-d13bb3bada5c tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-de313ebf-218c-40ab-809a-129f93e7fc68-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:29 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b831fb5f-ba67-42da-ac25-d13bb3bada5c tempest-ProjectMemberTests-784856624 None] Lock "cinder-de313ebf-218c-40ab-809a-129f93e7fc68-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:29 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b831fb5f-ba67-42da-ac25-d13bb3bada5c tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-quobyte-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:29 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b831fb5f-ba67-42da-ac25-d13bb3bada5c tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:29 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b831fb5f-ba67-42da-ac25-d13bb3bada5c tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-quobyte-de313ebf-218c-40ab-809a-129f93e7fc68" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:29 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b831fb5f-ba67-42da-ac25-d13bb3bada5c tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-de313ebf-218c-40ab-809a-129f93e7fc68" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-b831fb5f-ba67-42da-ac25-d13bb3bada5c tempest-ProjectMemberTests-784856624 None] Deleting offline snapshot de313ebf-218c-40ab-809a-129f93e7fc68 of volume 5e84caeb-58c6-4dd6-ba21-a3b509d00bd0 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:52:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-b831fb5f-ba67-42da-ac25-d13bb3bada5c tempest-ProjectMemberTests-784856624 None] snapshot_file for this snap is: volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0.de313ebf-218c-40ab-809a-129f93e7fc68 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:52:29 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[773dc4f2-d757-4484-ad69-e44a0eb319fd]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b831fb5f-ba67-42da-ac25-d13bb3bada5c tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0.de313ebf-218c-40ab-809a-129f93e7fc68 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:29 devstack sudo[108116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0.de313ebf-218c-40ab-809a-129f93e7fc68 Nov 02 15:52:29 devstack sudo[108116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:29 devstack sudo[108116]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b831fb5f-ba67-42da-ac25-d13bb3bada5c tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0.de313ebf-218c-40ab-809a-129f93e7fc68" returned: 0 in 0.350s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:29 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-b831fb5f-ba67-42da-ac25-d13bb3bada5c tempest-ProjectMemberTests-784856624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:52:29 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5850b99-5fa8-4920-a96a-f117bb18f8c2]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:29 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b831fb5f-ba67-42da-ac25-d13bb3bada5c tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:29 devstack sudo[108121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0 Nov 02 15:52:29 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:30 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b831fb5f-ba67-42da-ac25-d13bb3bada5c tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0" returned: 0 in 0.335s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b831fb5f-ba67-42da-ac25-d13bb3bada5c tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0.de313ebf-218c-40ab-809a-129f93e7fc68 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:30 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0.de313ebf-218c-40ab-809a-129f93e7fc68 Nov 02 15:52:30 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:30 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b831fb5f-ba67-42da-ac25-d13bb3bada5c tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0.de313ebf-218c-40ab-809a-129f93e7fc68" returned: 0 in 0.329s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b831fb5f-ba67-42da-ac25-d13bb3bada5c tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0.de313ebf-218c-40ab-809a-129f93e7fc68 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:30 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0.de313ebf-218c-40ab-809a-129f93e7fc68 Nov 02 15:52:30 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:30 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:30 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-b831fb5f-ba67-42da-ac25-d13bb3bada5c tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0.de313ebf-218c-40ab-809a-129f93e7fc68" returned: 0 in 0.247s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:30 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b831fb5f-ba67-42da-ac25-d13bb3bada5c tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-de313ebf-218c-40ab-809a-129f93e7fc68" released by "_delete_snapshot" :: held 1.356s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:30 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b831fb5f-ba67-42da-ac25-d13bb3bada5c tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0" released by "delete_snapshot" :: held 1.378s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:30 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-b831fb5f-ba67-42da-ac25-d13bb3bada5c tempest-ProjectMemberTests-784856624 None] Created reservations ['aaac99fb-994c-487d-b2d8-f7c48c232829', '771958cd-a1c6-4c1d-ad4f-93ccbca390c5', '8fd9f9ff-f6a7-4a1f-bd77-2cde539f07b9', '74180592-d6c0-40d8-b3dc-e86aa9772b5a'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:52:30 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-b831fb5f-ba67-42da-ac25-d13bb3bada5c tempest-ProjectMemberTests-784856624 None] Delete snapshot completed successfully. Nov 02 15:52:30 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-b831fb5f-ba67-42da-ac25-d13bb3bada5c tempest-ProjectMemberTests-784856624 None] Lock "cinder-de313ebf-218c-40ab-809a-129f93e7fc68-delete_snapshot" released by "delete_snapshot" :: held 1.508s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:31 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-fdab7821-c852-48bb-a899-47791321975d tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:31 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-fdab7821-c852-48bb-a899-47791321975d tempest-ProjectMemberTests-784856624 None] Lock "cinder-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:31 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-fdab7821-c852-48bb-a899-47791321975d tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-quobyte-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:31 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-fdab7821-c852-48bb-a899-47791321975d tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0" acquired by "delete_volume" :: waited 0.016s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:31 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a53c457-595a-4cf1-9e36-48bbbe3e9300]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-fdab7821-c852-48bb-a899-47791321975d tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:31 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0 Nov 02 15:52:31 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:31 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-fdab7821-c852-48bb-a899-47791321975d tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0" returned: 0 in 0.367s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:31 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-fdab7821-c852-48bb-a899-47791321975d tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:32 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0 Nov 02 15:52:32 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:32 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-fdab7821-c852-48bb-a899-47791321975d tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0" returned: 0 in 0.249s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:32 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-fdab7821-c852-48bb-a899-47791321975d tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0" released by "delete_volume" :: held 0.672s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:32 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-fdab7821-c852-48bb-a899-47791321975d tempest-ProjectMemberTests-784856624 None] Created reservations ['7a7142ab-7474-45a9-924d-4c4999e639bb', '8b46cef4-79ef-4bd6-b3a1-2ad1464489ac', '9eca8cd7-8d6c-4e21-9437-ae7bcb7b8a14', 'ab61f9c2-3bbd-4397-8f50-e658d30bc5e8'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:52:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-fdab7821-c852-48bb-a899-47791321975d tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-fdab7821-c852-48bb-a899-47791321975d tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-fdab7821-c852-48bb-a899-47791321975d tempest-ProjectMemberTests-784856624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:52:32 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-fdab7821-c852-48bb-a899-47791321975d tempest-ProjectMemberTests-784856624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:52:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-fdab7821-c852-48bb-a899-47791321975d tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-fdab7821-c852-48bb-a899-47791321975d tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:32 devstack sudo[108143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:52:32 devstack sudo[108143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:32 devstack sudo[108143]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:32 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-fdab7821-c852-48bb-a899-47791321975d tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.258s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:32 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-fdab7821-c852-48bb-a899-47791321975d tempest-ProjectMemberTests-784856624 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:52:32 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-fdab7821-c852-48bb-a899-47791321975d tempest-ProjectMemberTests-784856624 None] Deleted volume successfully. Nov 02 15:52:32 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-fdab7821-c852-48bb-a899-47791321975d tempest-ProjectMemberTests-784856624 None] Lock "cinder-5e84caeb-58c6-4dd6-ba21-a3b509d00bd0-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:33 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:52:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] Flow 'volume_create_manager' (cdb6bba5-729c-4b04-8d27-bcb08c3524c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:52:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee97ae11-c088-4acc-8748-7b47cd7eb5a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee97ae11-c088-4acc-8748-7b47cd7eb5a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1599719932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b4e61f-8bc7-407b-92e4-fd3d4d785568,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b52f00447124da7bdd3954d3f68d935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:52:33Z,use_quota=True,user_id='5a0e80e52f41462994336772e4eb18fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (906710a0-571f-420c-a602-a4f420c8828a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (906710a0-571f-420c-a602-a4f420c8828a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e183501c-8837-4811-803a-7cb60e5dfb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e183501c-8837-4811-803a-7cb60e5dfb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18b4e61f-8bc7-407b-92e4-fd3d4d785568', 'volume_name': 'volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6ffe59-04ea-4c55-8e17-536964e28c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea6ffe59-04ea-4c55-8e17-536964e28c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f04a68-bf87-45e0-ad4d-24601fc483cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:33 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] Volume 18b4e61f-8bc7-407b-92e4-fd3d4d785568: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568', 'volume_size': 1} Nov 02 15:52:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:52:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1599719932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b4e61f-8bc7-407b-92e4-fd3d4d785568,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b52f00447124da7bdd3954d3f68d935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:52:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:52:33Z,use_quota=True,user_id='5a0e80e52f41462994336772e4eb18fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:52:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] Creating volume 18b4e61f-8bc7-407b-92e4-fd3d4d785568 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:52:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:52:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:52:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:52:33 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:52:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:33 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568 1073741824 Nov 02 15:52:33 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:33 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568 1073741824" returned: 0 in 0.411s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:33 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568 Nov 02 15:52:33 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:33 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568" returned: 0 in 0.258s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:33 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:52:33 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f04a68-bf87-45e0-ad4d-24601fc483cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ee1217-a2e5-4c51-8570-25cf90a9daa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:33 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] Volume volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568 (18b4e61f-8bc7-407b-92e4-fd3d4d785568): created successfully Nov 02 15:52:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ee1217-a2e5-4c51-8570-25cf90a9daa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:33 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] Flow 'volume_create_manager' (cdb6bba5-729c-4b04-8d27-bcb08c3524c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:52:33 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-69d97d48-8081-4b20-9f1a-55057843ecc8 tempest-ProjectMemberTests-784856624 None] Created volume successfully. Nov 02 15:52:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-201e0e7f-dd0d-4d0f-9c04-6b17b88a71d6 tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-201e0e7f-dd0d-4d0f-9c04-6b17b88a71d6 tempest-ProjectMemberTests-784856624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:34 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-201e0e7f-dd0d-4d0f-9c04-6b17b88a71d6 tempest-ProjectMemberTests-784856624 None] Creating offline snapshot 5ecc11a8-7181-4b43-adbb-d9000d60fb13 of volume 18b4e61f-8bc7-407b-92e4-fd3d4d785568 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:52:34 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[144965d2-f22b-4aa3-996b-cc9e917d2d2a]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-201e0e7f-dd0d-4d0f-9c04-6b17b88a71d6 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:34 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568 Nov 02 15:52:34 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:34 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-201e0e7f-dd0d-4d0f-9c04-6b17b88a71d6 tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568" returned: 0 in 0.350s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:34 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-201e0e7f-dd0d-4d0f-9c04-6b17b88a71d6 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568.5ecc11a8-7181-4b43-adbb-d9000d60fb13 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:34 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568.5ecc11a8-7181-4b43-adbb-d9000d60fb13 1G Nov 02 15:52:34 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:35 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-201e0e7f-dd0d-4d0f-9c04-6b17b88a71d6 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568.5ecc11a8-7181-4b43-adbb-d9000d60fb13 1G" returned: 0 in 0.373s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-201e0e7f-dd0d-4d0f-9c04-6b17b88a71d6 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568.5ecc11a8-7181-4b43-adbb-d9000d60fb13 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:35 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568.5ecc11a8-7181-4b43-adbb-d9000d60fb13 Nov 02 15:52:35 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:35 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-201e0e7f-dd0d-4d0f-9c04-6b17b88a71d6 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568.5ecc11a8-7181-4b43-adbb-d9000d60fb13" returned: 0 in 0.298s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:35 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-201e0e7f-dd0d-4d0f-9c04-6b17b88a71d6 tempest-ProjectMemberTests-784856624 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568.5ecc11a8-7181-4b43-adbb-d9000d60fb13 is being set with open permissions: ugo+rw Nov 02 15:52:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-201e0e7f-dd0d-4d0f-9c04-6b17b88a71d6 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568.5ecc11a8-7181-4b43-adbb-d9000d60fb13 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:35 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568.5ecc11a8-7181-4b43-adbb-d9000d60fb13 Nov 02 15:52:35 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:35 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-201e0e7f-dd0d-4d0f-9c04-6b17b88a71d6 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568.5ecc11a8-7181-4b43-adbb-d9000d60fb13" returned: 0 in 0.240s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-201e0e7f-dd0d-4d0f-9c04-6b17b88a71d6 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:35 devstack sudo[108173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568.info Nov 02 15:52:35 devstack sudo[108173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:35 devstack sudo[108173]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-201e0e7f-dd0d-4d0f-9c04-6b17b88a71d6 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568.info" returned: 0 in 0.242s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:35 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-201e0e7f-dd0d-4d0f-9c04-6b17b88a71d6 tempest-ProjectMemberTests-784856624 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568.info is being set with open permissions: ugo+rw Nov 02 15:52:35 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-201e0e7f-dd0d-4d0f-9c04-6b17b88a71d6 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:35 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568.info Nov 02 15:52:35 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:36 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-201e0e7f-dd0d-4d0f-9c04-6b17b88a71d6 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568.info" returned: 0 in 0.225s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-201e0e7f-dd0d-4d0f-9c04-6b17b88a71d6 tempest-ProjectMemberTests-784856624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.808s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:36 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-201e0e7f-dd0d-4d0f-9c04-6b17b88a71d6 tempest-ProjectMemberTests-784856624 None] Create snapshot completed successfully Nov 02 15:52:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-367c4be3-16f2-43f3-882f-a63add150451 tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-5ecc11a8-7181-4b43-adbb-d9000d60fb13-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-367c4be3-16f2-43f3-882f-a63add150451 tempest-ProjectMemberTests-784856624 None] Lock "cinder-5ecc11a8-7181-4b43-adbb-d9000d60fb13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-367c4be3-16f2-43f3-882f-a63add150451 tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-quobyte-18b4e61f-8bc7-407b-92e4-fd3d4d785568" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-367c4be3-16f2-43f3-882f-a63add150451 tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-18b4e61f-8bc7-407b-92e4-fd3d4d785568" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-367c4be3-16f2-43f3-882f-a63add150451 tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-quobyte-5ecc11a8-7181-4b43-adbb-d9000d60fb13" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:36 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-367c4be3-16f2-43f3-882f-a63add150451 tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-5ecc11a8-7181-4b43-adbb-d9000d60fb13" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:36 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-367c4be3-16f2-43f3-882f-a63add150451 tempest-ProjectMemberTests-784856624 None] Deleting offline snapshot 5ecc11a8-7181-4b43-adbb-d9000d60fb13 of volume 18b4e61f-8bc7-407b-92e4-fd3d4d785568 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:52:36 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-367c4be3-16f2-43f3-882f-a63add150451 tempest-ProjectMemberTests-784856624 None] snapshot_file for this snap is: volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568.5ecc11a8-7181-4b43-adbb-d9000d60fb13 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:52:36 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[2feccad0-cfe4-42f1-a99b-c384bc56a329]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-367c4be3-16f2-43f3-882f-a63add150451 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568.5ecc11a8-7181-4b43-adbb-d9000d60fb13 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:36 devstack sudo[108180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568.5ecc11a8-7181-4b43-adbb-d9000d60fb13 Nov 02 15:52:36 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:36 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-367c4be3-16f2-43f3-882f-a63add150451 tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568.5ecc11a8-7181-4b43-adbb-d9000d60fb13" returned: 0 in 0.354s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:36 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-367c4be3-16f2-43f3-882f-a63add150451 tempest-ProjectMemberTests-784856624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:52:36 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f550e51f-09c2-4c62-9af2-01c11c8b0681]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:36 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-367c4be3-16f2-43f3-882f-a63add150451 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:36 devstack sudo[108185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568 Nov 02 15:52:36 devstack sudo[108185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:37 devstack sudo[108185]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-367c4be3-16f2-43f3-882f-a63add150451 tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568" returned: 0 in 0.346s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-367c4be3-16f2-43f3-882f-a63add150451 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568.5ecc11a8-7181-4b43-adbb-d9000d60fb13 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:37 devstack sudo[108190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568.5ecc11a8-7181-4b43-adbb-d9000d60fb13 Nov 02 15:52:37 devstack sudo[108190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:37 devstack sudo[108190]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-367c4be3-16f2-43f3-882f-a63add150451 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568.5ecc11a8-7181-4b43-adbb-d9000d60fb13" returned: 0 in 0.318s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-367c4be3-16f2-43f3-882f-a63add150451 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568.5ecc11a8-7181-4b43-adbb-d9000d60fb13 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:37 devstack sudo[108196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568.5ecc11a8-7181-4b43-adbb-d9000d60fb13 Nov 02 15:52:37 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:37 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:37 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-367c4be3-16f2-43f3-882f-a63add150451 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568.5ecc11a8-7181-4b43-adbb-d9000d60fb13" returned: 0 in 0.239s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:37 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-367c4be3-16f2-43f3-882f-a63add150451 tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-5ecc11a8-7181-4b43-adbb-d9000d60fb13" released by "_delete_snapshot" :: held 1.354s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:37 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-367c4be3-16f2-43f3-882f-a63add150451 tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-18b4e61f-8bc7-407b-92e4-fd3d4d785568" released by "delete_snapshot" :: held 1.375s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:37 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-367c4be3-16f2-43f3-882f-a63add150451 tempest-ProjectMemberTests-784856624 None] Created reservations ['a69da248-3d7d-4bfa-9595-eba1d168c409', '65400d74-fc7f-4bb9-ac47-ecccc4902e8b', '8ce6e2c8-ccf4-49bf-8156-ca54a88ca264', 'fa00f2b2-f3c6-48ed-bab2-7f06bd4df6f0'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:52:37 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-367c4be3-16f2-43f3-882f-a63add150451 tempest-ProjectMemberTests-784856624 None] Delete snapshot completed successfully. Nov 02 15:52:37 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-367c4be3-16f2-43f3-882f-a63add150451 tempest-ProjectMemberTests-784856624 None] Lock "cinder-5ecc11a8-7181-4b43-adbb-d9000d60fb13-delete_snapshot" released by "delete_snapshot" :: held 1.506s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:38 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-94402376-fc70-4c3c-aa16-0eefa5095450 tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-18b4e61f-8bc7-407b-92e4-fd3d4d785568-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:38 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-94402376-fc70-4c3c-aa16-0eefa5095450 tempest-ProjectMemberTests-784856624 None] Lock "cinder-18b4e61f-8bc7-407b-92e4-fd3d4d785568-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:38 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-94402376-fc70-4c3c-aa16-0eefa5095450 tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-quobyte-18b4e61f-8bc7-407b-92e4-fd3d4d785568" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:38 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-94402376-fc70-4c3c-aa16-0eefa5095450 tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-18b4e61f-8bc7-407b-92e4-fd3d4d785568" acquired by "delete_volume" :: waited 0.015s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:38 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cb8625-0127-4d2b-8ebc-8a21abec8d87]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:38 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-94402376-fc70-4c3c-aa16-0eefa5095450 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:38 devstack sudo[108199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568 Nov 02 15:52:38 devstack sudo[108199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:39 devstack sudo[108199]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-94402376-fc70-4c3c-aa16-0eefa5095450 tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568" returned: 0 in 0.354s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-94402376-fc70-4c3c-aa16-0eefa5095450 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:39 devstack sudo[108204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568 Nov 02 15:52:39 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:39 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-94402376-fc70-4c3c-aa16-0eefa5095450 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-18b4e61f-8bc7-407b-92e4-fd3d4d785568" returned: 0 in 0.264s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-94402376-fc70-4c3c-aa16-0eefa5095450 tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-18b4e61f-8bc7-407b-92e4-fd3d4d785568" released by "delete_volume" :: held 0.679s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:39 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-94402376-fc70-4c3c-aa16-0eefa5095450 tempest-ProjectMemberTests-784856624 None] Created reservations ['8a7be429-d503-4981-af4c-38c8856fc36b', '82fe252f-c20e-4a0a-9f4e-2647a50a782b', 'a7d1ce77-e55f-44ef-a134-2806567dbcad', '4d71836d-9147-42ab-a69a-83f24852ccdf'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:52:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-94402376-fc70-4c3c-aa16-0eefa5095450 tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-94402376-fc70-4c3c-aa16-0eefa5095450 tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:39 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-94402376-fc70-4c3c-aa16-0eefa5095450 tempest-ProjectMemberTests-784856624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:52:39 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-94402376-fc70-4c3c-aa16-0eefa5095450 tempest-ProjectMemberTests-784856624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:52:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-94402376-fc70-4c3c-aa16-0eefa5095450 tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-94402376-fc70-4c3c-aa16-0eefa5095450 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:39 devstack sudo[108207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:52:39 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:39 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:39 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-94402376-fc70-4c3c-aa16-0eefa5095450 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.250s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:39 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-94402376-fc70-4c3c-aa16-0eefa5095450 tempest-ProjectMemberTests-784856624 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:52:39 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-94402376-fc70-4c3c-aa16-0eefa5095450 tempest-ProjectMemberTests-784856624 None] Deleted volume successfully. Nov 02 15:52:39 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-94402376-fc70-4c3c-aa16-0eefa5095450 tempest-ProjectMemberTests-784856624 None] Lock "cinder-18b4e61f-8bc7-407b-92e4-fd3d4d785568-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:40 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:52:40 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] Flow 'volume_create_manager' (3ff3b086-949e-44a9-b3a3-dd13fd22be6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:52:40 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f70f67c1-a3e3-456a-a042-d645bd8b2c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:40 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f70f67c1-a3e3-456a-a042-d645bd8b2c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1892953492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e6e04e0-a347-4027-890b-bf9344291c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b52f00447124da7bdd3954d3f68d935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:52:40Z,use_quota=True,user_id='5a0e80e52f41462994336772e4eb18fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:40 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5de90bd-d6b8-4522-af96-56fe872c5da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:40 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5de90bd-d6b8-4522-af96-56fe872c5da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:40 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b1376e5-6cd5-4e18-bc9e-9a608aa1b93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:40 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b1376e5-6cd5-4e18-bc9e-9a608aa1b93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e6e04e0-a347-4027-890b-bf9344291c23', 'volume_name': 'volume-4e6e04e0-a347-4027-890b-bf9344291c23', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:40 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2974ae55-763d-4311-b006-6be627d2221d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:40 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2974ae55-763d-4311-b006-6be627d2221d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:40 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690e25ea-a4c4-40f0-a8cb-ba43cfe29d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:40 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] Volume 4e6e04e0-a347-4027-890b-bf9344291c23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e6e04e0-a347-4027-890b-bf9344291c23', 'volume_size': 1} Nov 02 15:52:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:40 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1892953492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e6e04e0-a347-4027-890b-bf9344291c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b52f00447124da7bdd3954d3f68d935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:52:40Z,use_quota=True,user_id='5a0e80e52f41462994336772e4eb18fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:52:40 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] Creating volume 4e6e04e0-a347-4027-890b-bf9344291c23 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:52:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:40 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:52:40 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:52:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:40 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:52:40 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:52:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:40 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23 1073741824 Nov 02 15:52:40 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:40 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23 1073741824" returned: 0 in 0.396s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:40 devstack sudo[108215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23 Nov 02 15:52:40 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:40 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23" returned: 0 in 0.246s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:40 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:52:40 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:40 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690e25ea-a4c4-40f0-a8cb-ba43cfe29d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e6e04e0-a347-4027-890b-bf9344291c23', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:40 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7851579f-7f77-4cb1-90f3-98524c8b0e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:40 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] Volume volume-4e6e04e0-a347-4027-890b-bf9344291c23 (4e6e04e0-a347-4027-890b-bf9344291c23): created successfully Nov 02 15:52:40 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7851579f-7f77-4cb1-90f3-98524c8b0e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:40 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] Flow 'volume_create_manager' (3ff3b086-949e-44a9-b3a3-dd13fd22be6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:52:40 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-a013d4e0-9718-4a99-82f0-b97d6d16e967 tempest-ProjectMemberTests-784856624 None] Created volume successfully. Nov 02 15:52:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-74b55a78-f89d-4404-9d5d-45da97de9554 tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-74b55a78-f89d-4404-9d5d-45da97de9554 tempest-ProjectMemberTests-784856624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:41 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-74b55a78-f89d-4404-9d5d-45da97de9554 tempest-ProjectMemberTests-784856624 None] Creating offline snapshot 75f53280-2251-434e-9b50-2906b2d7c4dd of volume 4e6e04e0-a347-4027-890b-bf9344291c23 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:52:41 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca554ee-1d3b-4027-92cc-ea1c1a3910ba]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-74b55a78-f89d-4404-9d5d-45da97de9554 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:41 devstack sudo[108218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23 Nov 02 15:52:41 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:41 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-74b55a78-f89d-4404-9d5d-45da97de9554 tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23" returned: 0 in 0.342s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:41 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-74b55a78-f89d-4404-9d5d-45da97de9554 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23.75f53280-2251-434e-9b50-2906b2d7c4dd 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:41 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23.75f53280-2251-434e-9b50-2906b2d7c4dd 1G Nov 02 15:52:41 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:42 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-74b55a78-f89d-4404-9d5d-45da97de9554 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23.75f53280-2251-434e-9b50-2906b2d7c4dd 1G" returned: 0 in 0.435s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-74b55a78-f89d-4404-9d5d-45da97de9554 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6e04e0-a347-4027-890b-bf9344291c23 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23.75f53280-2251-434e-9b50-2906b2d7c4dd {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:42 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6e04e0-a347-4027-890b-bf9344291c23 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23.75f53280-2251-434e-9b50-2906b2d7c4dd Nov 02 15:52:42 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:42 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-74b55a78-f89d-4404-9d5d-45da97de9554 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4e6e04e0-a347-4027-890b-bf9344291c23 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23.75f53280-2251-434e-9b50-2906b2d7c4dd" returned: 0 in 0.298s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:42 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-74b55a78-f89d-4404-9d5d-45da97de9554 tempest-ProjectMemberTests-784856624 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23.75f53280-2251-434e-9b50-2906b2d7c4dd is being set with open permissions: ugo+rw Nov 02 15:52:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-74b55a78-f89d-4404-9d5d-45da97de9554 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23.75f53280-2251-434e-9b50-2906b2d7c4dd {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:42 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23.75f53280-2251-434e-9b50-2906b2d7c4dd Nov 02 15:52:42 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:42 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-74b55a78-f89d-4404-9d5d-45da97de9554 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23.75f53280-2251-434e-9b50-2906b2d7c4dd" returned: 0 in 0.228s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-74b55a78-f89d-4404-9d5d-45da97de9554 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:42 devstack sudo[108236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23.info Nov 02 15:52:42 devstack sudo[108236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:42 devstack sudo[108236]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-74b55a78-f89d-4404-9d5d-45da97de9554 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23.info" returned: 0 in 0.281s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:42 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-74b55a78-f89d-4404-9d5d-45da97de9554 tempest-ProjectMemberTests-784856624 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23.info is being set with open permissions: ugo+rw Nov 02 15:52:42 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-74b55a78-f89d-4404-9d5d-45da97de9554 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:42 devstack sudo[108239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23.info Nov 02 15:52:42 devstack sudo[108239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:43 devstack sudo[108239]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-74b55a78-f89d-4404-9d5d-45da97de9554 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23.info" returned: 0 in 0.228s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-74b55a78-f89d-4404-9d5d-45da97de9554 tempest-ProjectMemberTests-784856624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.893s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:43 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-74b55a78-f89d-4404-9d5d-45da97de9554 tempest-ProjectMemberTests-784856624 None] Create snapshot completed successfully Nov 02 15:52:43 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6e231bc7-b6e9-4862-85ec-2c3db93309ee tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-75f53280-2251-434e-9b50-2906b2d7c4dd-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:43 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6e231bc7-b6e9-4862-85ec-2c3db93309ee tempest-ProjectMemberTests-784856624 None] Lock "cinder-75f53280-2251-434e-9b50-2906b2d7c4dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:43 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6e231bc7-b6e9-4862-85ec-2c3db93309ee tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-quobyte-4e6e04e0-a347-4027-890b-bf9344291c23" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:43 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6e231bc7-b6e9-4862-85ec-2c3db93309ee tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-4e6e04e0-a347-4027-890b-bf9344291c23" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:43 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6e231bc7-b6e9-4862-85ec-2c3db93309ee tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-quobyte-75f53280-2251-434e-9b50-2906b2d7c4dd" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:43 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6e231bc7-b6e9-4862-85ec-2c3db93309ee tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-75f53280-2251-434e-9b50-2906b2d7c4dd" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-6e231bc7-b6e9-4862-85ec-2c3db93309ee tempest-ProjectMemberTests-784856624 None] Deleting offline snapshot 75f53280-2251-434e-9b50-2906b2d7c4dd of volume 4e6e04e0-a347-4027-890b-bf9344291c23 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:52:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-6e231bc7-b6e9-4862-85ec-2c3db93309ee tempest-ProjectMemberTests-784856624 None] snapshot_file for this snap is: volume-4e6e04e0-a347-4027-890b-bf9344291c23.75f53280-2251-434e-9b50-2906b2d7c4dd {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:52:43 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfe11b1-6660-4b7b-944b-e6eb8b42fa87]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6e231bc7-b6e9-4862-85ec-2c3db93309ee tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23.75f53280-2251-434e-9b50-2906b2d7c4dd {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:43 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23.75f53280-2251-434e-9b50-2906b2d7c4dd Nov 02 15:52:43 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:43 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6e231bc7-b6e9-4862-85ec-2c3db93309ee tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23.75f53280-2251-434e-9b50-2906b2d7c4dd" returned: 0 in 0.366s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:43 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-6e231bc7-b6e9-4862-85ec-2c3db93309ee tempest-ProjectMemberTests-784856624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e6e04e0-a347-4027-890b-bf9344291c23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:52:43 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73b2cb0-8b05-471c-af50-d70c09058f90]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:43 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6e231bc7-b6e9-4862-85ec-2c3db93309ee tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:44 devstack sudo[108248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23 Nov 02 15:52:44 devstack sudo[108248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:44 devstack sudo[108248]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6e231bc7-b6e9-4862-85ec-2c3db93309ee tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23" returned: 0 in 0.352s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6e231bc7-b6e9-4862-85ec-2c3db93309ee tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23.75f53280-2251-434e-9b50-2906b2d7c4dd {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:44 devstack sudo[108253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23.75f53280-2251-434e-9b50-2906b2d7c4dd Nov 02 15:52:44 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:44 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6e231bc7-b6e9-4862-85ec-2c3db93309ee tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23.75f53280-2251-434e-9b50-2906b2d7c4dd" returned: 0 in 0.352s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6e231bc7-b6e9-4862-85ec-2c3db93309ee tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23.75f53280-2251-434e-9b50-2906b2d7c4dd {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:44 devstack sudo[108258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23.75f53280-2251-434e-9b50-2906b2d7c4dd Nov 02 15:52:44 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:44 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:44 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-6e231bc7-b6e9-4862-85ec-2c3db93309ee tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23.75f53280-2251-434e-9b50-2906b2d7c4dd" returned: 0 in 0.235s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:44 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6e231bc7-b6e9-4862-85ec-2c3db93309ee tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-75f53280-2251-434e-9b50-2906b2d7c4dd" released by "_delete_snapshot" :: held 1.398s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:44 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6e231bc7-b6e9-4862-85ec-2c3db93309ee tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-4e6e04e0-a347-4027-890b-bf9344291c23" released by "delete_snapshot" :: held 1.417s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:44 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-6e231bc7-b6e9-4862-85ec-2c3db93309ee tempest-ProjectMemberTests-784856624 None] Created reservations ['7955b983-485b-4e18-921a-5c785ce57662', 'd44dcf90-06e7-4c1b-8dd7-f89d5049357a', 'cfb0dc52-a7c9-4f9b-a63b-78e7547487d3', 'b4515999-a01e-4634-a86f-cbcc9a303b38'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:52:45 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-6e231bc7-b6e9-4862-85ec-2c3db93309ee tempest-ProjectMemberTests-784856624 None] Delete snapshot completed successfully. Nov 02 15:52:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-6e231bc7-b6e9-4862-85ec-2c3db93309ee tempest-ProjectMemberTests-784856624 None] Lock "cinder-75f53280-2251-434e-9b50-2906b2d7c4dd-delete_snapshot" released by "delete_snapshot" :: held 1.545s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4541b55f-35b6-45b8-92a5-c675f416e82f tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-4e6e04e0-a347-4027-890b-bf9344291c23-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4541b55f-35b6-45b8-92a5-c675f416e82f tempest-ProjectMemberTests-784856624 None] Lock "cinder-4e6e04e0-a347-4027-890b-bf9344291c23-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4541b55f-35b6-45b8-92a5-c675f416e82f tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-quobyte-4e6e04e0-a347-4027-890b-bf9344291c23" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:45 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4541b55f-35b6-45b8-92a5-c675f416e82f tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-4e6e04e0-a347-4027-890b-bf9344291c23" acquired by "delete_volume" :: waited 0.015s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:45 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[516b09cb-cfcf-41bd-8eb8-ba1d1b975b8a]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:45 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4541b55f-35b6-45b8-92a5-c675f416e82f tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:45 devstack sudo[108261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23 Nov 02 15:52:45 devstack sudo[108261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:46 devstack sudo[108261]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4541b55f-35b6-45b8-92a5-c675f416e82f tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23" returned: 0 in 0.347s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4541b55f-35b6-45b8-92a5-c675f416e82f tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:46 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23 Nov 02 15:52:46 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:46 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4541b55f-35b6-45b8-92a5-c675f416e82f tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-4e6e04e0-a347-4027-890b-bf9344291c23" returned: 0 in 0.229s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:46 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4541b55f-35b6-45b8-92a5-c675f416e82f tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-4e6e04e0-a347-4027-890b-bf9344291c23" released by "delete_volume" :: held 0.646s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:46 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-4541b55f-35b6-45b8-92a5-c675f416e82f tempest-ProjectMemberTests-784856624 None] Created reservations ['eac8feaa-b7b0-4a88-afb9-3c5407a8ddf7', '0e91d1df-61e0-42e1-8205-6bfed107dac8', '6251130c-5ac8-44e0-a51a-da4a73c2fda4', 'a68639cd-c952-4820-8c73-7a1a3f1a4452'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:52:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4541b55f-35b6-45b8-92a5-c675f416e82f tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4541b55f-35b6-45b8-92a5-c675f416e82f tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:46 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4541b55f-35b6-45b8-92a5-c675f416e82f tempest-ProjectMemberTests-784856624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:52:46 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-4541b55f-35b6-45b8-92a5-c675f416e82f tempest-ProjectMemberTests-784856624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:52:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-4541b55f-35b6-45b8-92a5-c675f416e82f tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4541b55f-35b6-45b8-92a5-c675f416e82f tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:46 devstack sudo[108273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:52:46 devstack sudo[108273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:46 devstack sudo[108273]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:46 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-4541b55f-35b6-45b8-92a5-c675f416e82f tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.254s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:46 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-4541b55f-35b6-45b8-92a5-c675f416e82f tempest-ProjectMemberTests-784856624 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:52:46 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-4541b55f-35b6-45b8-92a5-c675f416e82f tempest-ProjectMemberTests-784856624 None] Deleted volume successfully. Nov 02 15:52:46 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-4541b55f-35b6-45b8-92a5-c675f416e82f tempest-ProjectMemberTests-784856624 None] Lock "cinder-4e6e04e0-a347-4027-890b-bf9344291c23-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:47 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:52:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] Flow 'volume_create_manager' (e982dd19-9228-458d-b073-bd7360caaee4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:52:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23d8c7ff-0522-46dc-a4dd-b2036bf6665d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23d8c7ff-0522-46dc-a4dd-b2036bf6665d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-73116325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c001e0c8-a435-4d88-9143-6371f3394613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b52f00447124da7bdd3954d3f68d935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:52:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:52:47Z,use_quota=True,user_id='5a0e80e52f41462994336772e4eb18fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76441e1a-b097-4e4e-a7b9-fdd1d2daa230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76441e1a-b097-4e4e-a7b9-fdd1d2daa230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d283d2-13b6-48cf-a08b-908e8ae18043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46d283d2-13b6-48cf-a08b-908e8ae18043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c001e0c8-a435-4d88-9143-6371f3394613', 'volume_name': 'volume-c001e0c8-a435-4d88-9143-6371f3394613', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b465fe2e-0cd5-4a5a-9bf9-616d8366637d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b465fe2e-0cd5-4a5a-9bf9-616d8366637d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48adc8f0-14ce-4d9b-aef6-e303dd50bead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:47 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] Volume c001e0c8-a435-4d88-9143-6371f3394613: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c001e0c8-a435-4d88-9143-6371f3394613', 'volume_size': 1} Nov 02 15:52:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:47 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:52:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-73116325',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c001e0c8-a435-4d88-9143-6371f3394613,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b52f00447124da7bdd3954d3f68d935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:52:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:52:47Z,use_quota=True,user_id='5a0e80e52f41462994336772e4eb18fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:52:47 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] Creating volume c001e0c8-a435-4d88-9143-6371f3394613 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:52:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:47 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:52:47 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:52:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:47 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:52:47 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:52:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:47 devstack sudo[108276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613 1073741824 Nov 02 15:52:47 devstack sudo[108276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:47 devstack sudo[108276]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613 1073741824" returned: 0 in 0.390s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:47 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613 Nov 02 15:52:47 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:47 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613" returned: 0 in 0.236s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:47 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] <== create_volume: return (667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:52:47 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.670s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48adc8f0-14ce-4d9b-aef6-e303dd50bead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c001e0c8-a435-4d88-9143-6371f3394613', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d250b292-517a-4508-93d6-f72a8adb3be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:47 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] Volume volume-c001e0c8-a435-4d88-9143-6371f3394613 (c001e0c8-a435-4d88-9143-6371f3394613): created successfully Nov 02 15:52:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d250b292-517a-4508-93d6-f72a8adb3be2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:47 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] Flow 'volume_create_manager' (e982dd19-9228-458d-b073-bd7360caaee4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:52:48 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-8de0ebf6-e143-49e6-811f-d10e0b02450e tempest-ProjectMemberTests-784856624 None] Created volume successfully. Nov 02 15:52:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-acf91b28-5a9a-4d97-b2ff-b05b35549ed5 tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-acf91b28-5a9a-4d97-b2ff-b05b35549ed5 tempest-ProjectMemberTests-784856624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:48 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-acf91b28-5a9a-4d97-b2ff-b05b35549ed5 tempest-ProjectMemberTests-784856624 None] Creating offline snapshot e74eb490-1ac0-45c1-b316-091fdeef907e of volume c001e0c8-a435-4d88-9143-6371f3394613 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:52:48 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bb43b6-7392-4efb-af8d-7cd0dcfb417e]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-acf91b28-5a9a-4d97-b2ff-b05b35549ed5 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:48 devstack sudo[108284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613 Nov 02 15:52:48 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:48 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-acf91b28-5a9a-4d97-b2ff-b05b35549ed5 tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613" returned: 0 in 0.349s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:48 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-acf91b28-5a9a-4d97-b2ff-b05b35549ed5 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613.e74eb490-1ac0-45c1-b316-091fdeef907e 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:48 devstack sudo[108289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613.e74eb490-1ac0-45c1-b316-091fdeef907e 1G Nov 02 15:52:48 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:49 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-acf91b28-5a9a-4d97-b2ff-b05b35549ed5 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613.e74eb490-1ac0-45c1-b316-091fdeef907e 1G" returned: 0 in 0.420s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-acf91b28-5a9a-4d97-b2ff-b05b35549ed5 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c001e0c8-a435-4d88-9143-6371f3394613 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613.e74eb490-1ac0-45c1-b316-091fdeef907e {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:49 devstack sudo[108294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c001e0c8-a435-4d88-9143-6371f3394613 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613.e74eb490-1ac0-45c1-b316-091fdeef907e Nov 02 15:52:49 devstack sudo[108294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:49 devstack sudo[108294]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-acf91b28-5a9a-4d97-b2ff-b05b35549ed5 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c001e0c8-a435-4d88-9143-6371f3394613 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613.e74eb490-1ac0-45c1-b316-091fdeef907e" returned: 0 in 0.289s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:49 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-acf91b28-5a9a-4d97-b2ff-b05b35549ed5 tempest-ProjectMemberTests-784856624 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613.e74eb490-1ac0-45c1-b316-091fdeef907e is being set with open permissions: ugo+rw Nov 02 15:52:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-acf91b28-5a9a-4d97-b2ff-b05b35549ed5 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613.e74eb490-1ac0-45c1-b316-091fdeef907e {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:49 devstack sudo[108300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613.e74eb490-1ac0-45c1-b316-091fdeef907e Nov 02 15:52:49 devstack sudo[108300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:49 devstack sudo[108300]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-acf91b28-5a9a-4d97-b2ff-b05b35549ed5 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613.e74eb490-1ac0-45c1-b316-091fdeef907e" returned: 0 in 0.236s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:49 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-acf91b28-5a9a-4d97-b2ff-b05b35549ed5 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:49 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613.info Nov 02 15:52:49 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:49 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-acf91b28-5a9a-4d97-b2ff-b05b35549ed5 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613.info" returned: 0 in 0.258s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:50 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-acf91b28-5a9a-4d97-b2ff-b05b35549ed5 tempest-ProjectMemberTests-784856624 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613.info is being set with open permissions: ugo+rw Nov 02 15:52:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-acf91b28-5a9a-4d97-b2ff-b05b35549ed5 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:50 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613.info Nov 02 15:52:50 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:50 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-acf91b28-5a9a-4d97-b2ff-b05b35549ed5 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613.info" returned: 0 in 0.253s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-acf91b28-5a9a-4d97-b2ff-b05b35549ed5 tempest-ProjectMemberTests-784856624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.887s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:50 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-acf91b28-5a9a-4d97-b2ff-b05b35549ed5 tempest-ProjectMemberTests-784856624 None] Create snapshot completed successfully Nov 02 15:52:50 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-40266f87-d8fa-4262-8edf-21554f15c2ff tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-e74eb490-1ac0-45c1-b316-091fdeef907e-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:50 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-40266f87-d8fa-4262-8edf-21554f15c2ff tempest-ProjectMemberTests-784856624 None] Lock "cinder-e74eb490-1ac0-45c1-b316-091fdeef907e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:50 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-40266f87-d8fa-4262-8edf-21554f15c2ff tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-quobyte-c001e0c8-a435-4d88-9143-6371f3394613" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:50 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-40266f87-d8fa-4262-8edf-21554f15c2ff tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-c001e0c8-a435-4d88-9143-6371f3394613" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:50 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-40266f87-d8fa-4262-8edf-21554f15c2ff tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-quobyte-e74eb490-1ac0-45c1-b316-091fdeef907e" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:50 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-40266f87-d8fa-4262-8edf-21554f15c2ff tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-e74eb490-1ac0-45c1-b316-091fdeef907e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:50 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-40266f87-d8fa-4262-8edf-21554f15c2ff tempest-ProjectMemberTests-784856624 None] Deleting offline snapshot e74eb490-1ac0-45c1-b316-091fdeef907e of volume c001e0c8-a435-4d88-9143-6371f3394613 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:52:50 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-40266f87-d8fa-4262-8edf-21554f15c2ff tempest-ProjectMemberTests-784856624 None] snapshot_file for this snap is: volume-c001e0c8-a435-4d88-9143-6371f3394613.e74eb490-1ac0-45c1-b316-091fdeef907e {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:52:50 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2788aba-ccd2-4080-923b-8603bd56362e]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-40266f87-d8fa-4262-8edf-21554f15c2ff tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613.e74eb490-1ac0-45c1-b316-091fdeef907e {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:50 devstack sudo[108309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613.e74eb490-1ac0-45c1-b316-091fdeef907e Nov 02 15:52:50 devstack sudo[108309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:50 devstack sudo[108309]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:50 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-40266f87-d8fa-4262-8edf-21554f15c2ff tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613.e74eb490-1ac0-45c1-b316-091fdeef907e" returned: 0 in 0.364s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:50 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-40266f87-d8fa-4262-8edf-21554f15c2ff tempest-ProjectMemberTests-784856624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c001e0c8-a435-4d88-9143-6371f3394613(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:52:51 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e65567-0f52-49c8-a934-7c50f8634911]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-40266f87-d8fa-4262-8edf-21554f15c2ff tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:51 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613 Nov 02 15:52:51 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:51 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-40266f87-d8fa-4262-8edf-21554f15c2ff tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613" returned: 0 in 0.331s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-40266f87-d8fa-4262-8edf-21554f15c2ff tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613.e74eb490-1ac0-45c1-b316-091fdeef907e {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:51 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613.e74eb490-1ac0-45c1-b316-091fdeef907e Nov 02 15:52:51 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:51 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-40266f87-d8fa-4262-8edf-21554f15c2ff tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613.e74eb490-1ac0-45c1-b316-091fdeef907e" returned: 0 in 0.333s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-40266f87-d8fa-4262-8edf-21554f15c2ff tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613.e74eb490-1ac0-45c1-b316-091fdeef907e {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:51 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613.e74eb490-1ac0-45c1-b316-091fdeef907e Nov 02 15:52:51 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:51 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:51 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-40266f87-d8fa-4262-8edf-21554f15c2ff tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613.e74eb490-1ac0-45c1-b316-091fdeef907e" returned: 0 in 0.241s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:51 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-40266f87-d8fa-4262-8edf-21554f15c2ff tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-e74eb490-1ac0-45c1-b316-091fdeef907e" released by "_delete_snapshot" :: held 1.364s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:51 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-40266f87-d8fa-4262-8edf-21554f15c2ff tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-c001e0c8-a435-4d88-9143-6371f3394613" released by "delete_snapshot" :: held 1.385s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:52 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-40266f87-d8fa-4262-8edf-21554f15c2ff tempest-ProjectMemberTests-784856624 None] Created reservations ['0c482696-90a7-4816-8e9c-9d832b46dcca', 'cbbfeb82-de59-4ddf-97bf-97e8d9592da6', '6d7b7cbc-8e13-4b4b-a2e9-5194541464c3', 'cae41ed5-0cc6-4fc9-9e1a-e570ef11b9b5'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:52:52 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-40266f87-d8fa-4262-8edf-21554f15c2ff tempest-ProjectMemberTests-784856624 None] Delete snapshot completed successfully. Nov 02 15:52:52 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-40266f87-d8fa-4262-8edf-21554f15c2ff tempest-ProjectMemberTests-784856624 None] Lock "cinder-e74eb490-1ac0-45c1-b316-091fdeef907e-delete_snapshot" released by "delete_snapshot" :: held 1.521s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:52 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f6865582-1eed-49de-8365-c3c29b8116c5 tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-c001e0c8-a435-4d88-9143-6371f3394613-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:52 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f6865582-1eed-49de-8365-c3c29b8116c5 tempest-ProjectMemberTests-784856624 None] Lock "cinder-c001e0c8-a435-4d88-9143-6371f3394613-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:52 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f6865582-1eed-49de-8365-c3c29b8116c5 tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-quobyte-c001e0c8-a435-4d88-9143-6371f3394613" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:52 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f6865582-1eed-49de-8365-c3c29b8116c5 tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-c001e0c8-a435-4d88-9143-6371f3394613" acquired by "delete_volume" :: waited 0.016s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:52 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae23e18-165d-4dce-8e76-17cd8052d6dd]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:52 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f6865582-1eed-49de-8365-c3c29b8116c5 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:52 devstack sudo[108327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613 Nov 02 15:52:52 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:53 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f6865582-1eed-49de-8365-c3c29b8116c5 tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613" returned: 0 in 0.338s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f6865582-1eed-49de-8365-c3c29b8116c5 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:53 devstack sudo[108332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613 Nov 02 15:52:53 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:53 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f6865582-1eed-49de-8365-c3c29b8116c5 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-c001e0c8-a435-4d88-9143-6371f3394613" returned: 0 in 0.225s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:53 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f6865582-1eed-49de-8365-c3c29b8116c5 tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-c001e0c8-a435-4d88-9143-6371f3394613" released by "delete_volume" :: held 0.622s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:53 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-f6865582-1eed-49de-8365-c3c29b8116c5 tempest-ProjectMemberTests-784856624 None] Created reservations ['f2649d24-3337-45a0-90e8-6ba2b6a3952c', '1b499f77-2b5f-4863-a363-f0ea85454787', '7a9722b6-248d-4bb6-9590-a903821e9fd4', '0b22471e-ab89-4efc-9e8c-3aa1334475fc'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:52:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f6865582-1eed-49de-8365-c3c29b8116c5 tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f6865582-1eed-49de-8365-c3c29b8116c5 tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:53 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f6865582-1eed-49de-8365-c3c29b8116c5 tempest-ProjectMemberTests-784856624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:52:53 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-f6865582-1eed-49de-8365-c3c29b8116c5 tempest-ProjectMemberTests-784856624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:52:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-f6865582-1eed-49de-8365-c3c29b8116c5 tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f6865582-1eed-49de-8365-c3c29b8116c5 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:53 devstack sudo[108335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:52:53 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:53 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:53 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-f6865582-1eed-49de-8365-c3c29b8116c5 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.235s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:53 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-f6865582-1eed-49de-8365-c3c29b8116c5 tempest-ProjectMemberTests-784856624 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:52:53 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-f6865582-1eed-49de-8365-c3c29b8116c5 tempest-ProjectMemberTests-784856624 None] Deleted volume successfully. Nov 02 15:52:53 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-f6865582-1eed-49de-8365-c3c29b8116c5 tempest-ProjectMemberTests-784856624 None] Lock "cinder-c001e0c8-a435-4d88-9143-6371f3394613-delete_volume" released by "delete_volume" :: held 1.041s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:54 devstack cinder-volume[86703]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86703) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 02 15:52:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] Flow 'volume_create_manager' (cff62e38-a93f-4ff8-8411-cd9112e1b9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:52:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db92632-1ee0-4449-8e04-10edfec5c305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7db92632-1ee0-4449-8e04-10edfec5c305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-274423822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e74df1ed-dc60-4f8d-91e3-7ce67c87f959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b52f00447124da7bdd3954d3f68d935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:52:54Z,use_quota=True,user_id='5a0e80e52f41462994336772e4eb18fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (297a4ffb-367f-4faa-b8e3-08a898daae44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (297a4ffb-367f-4faa-b8e3-08a898daae44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5b79f2-bfdf-4196-b371-724823d10c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b5b79f2-bfdf-4196-b371-724823d10c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e74df1ed-dc60-4f8d-91e3-7ce67c87f959', 'volume_name': 'volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8142ae2e-809a-4906-bd46-ddec1146c0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8142ae2e-809a-4906-bd46-ddec1146c0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:54 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a76d123-6c63-460a-89d7-f93f8d1753fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:54 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] Volume e74df1ed-dc60-4f8d-91e3-7ce67c87f959: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959', 'volume_size': 1} Nov 02 15:52:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:54 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-02T14:52:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-274423822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e74df1ed-dc60-4f8d-91e3-7ce67c87f959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b52f00447124da7bdd3954d3f68d935',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-02T14:52:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-02T14:52:54Z,use_quota=True,user_id='5a0e80e52f41462994336772e4eb18fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cea4c39d-5a63-47d9-9eca-1b8c7ee71303),volume_type_id=cea4c39d-5a63-47d9-9eca-1b8c7ee71303)}" {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 02 15:52:54 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] Creating volume e74df1ed-dc60-4f8d-91e3-7ce67c87f959 {{(pid=86703) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 02 15:52:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:54 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:52:54 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:52:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:54 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] Selected osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 as target Quobyte volume. {{(pid=86703) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 02 15:52:54 devstack cinder-volume[86703]: INFO cinder.volume.drivers.remotefs [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] casted to osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478 Nov 02 15:52:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959 1073741824 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:54 devstack sudo[108338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959 1073741824 Nov 02 15:52:54 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:54 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959 1073741824" returned: 0 in 0.399s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:54 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:54 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959 Nov 02 15:52:54 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:55 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959" returned: 0 in 0.229s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:55 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'} {{(pid=86703) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 02 15:52:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:55 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a76d123-6c63-460a-89d7-f93f8d1753fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959', 'volume_size': 1}' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:55 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8796a0bc-0d47-4e2b-9d95-a52498959d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 02 15:52:55 devstack cinder-volume[86703]: INFO cinder.volume.flows.manager.create_volume [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] Volume volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959 (e74df1ed-dc60-4f8d-91e3-7ce67c87f959): created successfully Nov 02 15:52:55 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8796a0bc-0d47-4e2b-9d95-a52498959d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86703) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 02 15:52:55 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] Flow 'volume_create_manager' (cff62e38-a93f-4ff8-8411-cd9112e1b9e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86703) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 02 15:52:55 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-8c9bc48e-7b23-45e0-8cac-e31be3859337 tempest-ProjectMemberTests-784856624 None] Created volume successfully. Nov 02 15:52:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5f55581f-dc5e-485e-b57f-38c44cdd937a tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:52:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5f55581f-dc5e-485e-b57f-38c44cdd937a tempest-ProjectMemberTests-784856624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:52:55 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-5f55581f-dc5e-485e-b57f-38c44cdd937a tempest-ProjectMemberTests-784856624 None] Creating offline snapshot 1d8b2a0f-8b0a-4393-a188-b8a9ed929865 of volume e74df1ed-dc60-4f8d-91e3-7ce67c87f959 {{(pid=86703) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 02 15:52:55 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[884eb808-1978-4cbf-9fbf-0b8bb04e5ba8]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5f55581f-dc5e-485e-b57f-38c44cdd937a tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:55 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959 Nov 02 15:52:55 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:55 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5f55581f-dc5e-485e-b57f-38c44cdd937a tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959" returned: 0 in 0.357s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:55 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5f55581f-dc5e-485e-b57f-38c44cdd937a tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959.1d8b2a0f-8b0a-4393-a188-b8a9ed929865 1G {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:55 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959.1d8b2a0f-8b0a-4393-a188-b8a9ed929865 1G Nov 02 15:52:55 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:56 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5f55581f-dc5e-485e-b57f-38c44cdd937a tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959.1d8b2a0f-8b0a-4393-a188-b8a9ed929865 1G" returned: 0 in 0.368s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5f55581f-dc5e-485e-b57f-38c44cdd937a tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959.1d8b2a0f-8b0a-4393-a188-b8a9ed929865 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:56 devstack sudo[108357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959.1d8b2a0f-8b0a-4393-a188-b8a9ed929865 Nov 02 15:52:56 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:56 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5f55581f-dc5e-485e-b57f-38c44cdd937a tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959 -F qcow2 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959.1d8b2a0f-8b0a-4393-a188-b8a9ed929865" returned: 0 in 0.285s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:56 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-5f55581f-dc5e-485e-b57f-38c44cdd937a tempest-ProjectMemberTests-784856624 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959.1d8b2a0f-8b0a-4393-a188-b8a9ed929865 is being set with open permissions: ugo+rw Nov 02 15:52:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5f55581f-dc5e-485e-b57f-38c44cdd937a tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959.1d8b2a0f-8b0a-4393-a188-b8a9ed929865 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:56 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959.1d8b2a0f-8b0a-4393-a188-b8a9ed929865 Nov 02 15:52:56 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:56 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5f55581f-dc5e-485e-b57f-38c44cdd937a tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959.1d8b2a0f-8b0a-4393-a188-b8a9ed929865" returned: 0 in 0.232s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:56 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5f55581f-dc5e-485e-b57f-38c44cdd937a tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:56 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959.info Nov 02 15:52:56 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:57 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5f55581f-dc5e-485e-b57f-38c44cdd937a tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959.info" returned: 0 in 0.243s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:57 devstack cinder-volume[86703]: WARNING cinder.volume.drivers.remotefs [None req-5f55581f-dc5e-485e-b57f-38c44cdd937a tempest-ProjectMemberTests-784856624 None] /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959.info is being set with open permissions: ugo+rw Nov 02 15:52:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5f55581f-dc5e-485e-b57f-38c44cdd937a tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959.info {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:57 devstack sudo[108369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959.info Nov 02 15:52:57 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:57 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-5f55581f-dc5e-485e-b57f-38c44cdd937a tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959.info" returned: 0 in 0.229s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-5f55581f-dc5e-485e-b57f-38c44cdd937a tempest-ProjectMemberTests-784856624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.786s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:52:57 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-5f55581f-dc5e-485e-b57f-38c44cdd937a tempest-ProjectMemberTests-784856624 None] Create snapshot completed successfully Nov 02 15:52:57 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d2a40df0-2761-4f87-b8fb-ecc6e444d2f6 tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-1d8b2a0f-8b0a-4393-a188-b8a9ed929865-delete_snapshot" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:57 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d2a40df0-2761-4f87-b8fb-ecc6e444d2f6 tempest-ProjectMemberTests-784856624 None] Lock "cinder-1d8b2a0f-8b0a-4393-a188-b8a9ed929865-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:57 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d2a40df0-2761-4f87-b8fb-ecc6e444d2f6 tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-quobyte-e74df1ed-dc60-4f8d-91e3-7ce67c87f959" by "delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:57 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d2a40df0-2761-4f87-b8fb-ecc6e444d2f6 tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-e74df1ed-dc60-4f8d-91e3-7ce67c87f959" acquired by "delete_snapshot" :: waited 0.012s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:57 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d2a40df0-2761-4f87-b8fb-ecc6e444d2f6 tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-quobyte-1d8b2a0f-8b0a-4393-a188-b8a9ed929865" by "_delete_snapshot" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:57 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d2a40df0-2761-4f87-b8fb-ecc6e444d2f6 tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-1d8b2a0f-8b0a-4393-a188-b8a9ed929865" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-d2a40df0-2761-4f87-b8fb-ecc6e444d2f6 tempest-ProjectMemberTests-784856624 None] Deleting offline snapshot 1d8b2a0f-8b0a-4393-a188-b8a9ed929865 of volume e74df1ed-dc60-4f8d-91e3-7ce67c87f959 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 02 15:52:57 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-d2a40df0-2761-4f87-b8fb-ecc6e444d2f6 tempest-ProjectMemberTests-784856624 None] snapshot_file for this snap is: volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959.1d8b2a0f-8b0a-4393-a188-b8a9ed929865 {{(pid=86703) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 02 15:52:57 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[470a1947-5a42-4eb6-8dda-1fd00e8799df]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:57 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d2a40df0-2761-4f87-b8fb-ecc6e444d2f6 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959.1d8b2a0f-8b0a-4393-a188-b8a9ed929865 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:57 devstack sudo[108374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959.1d8b2a0f-8b0a-4393-a188-b8a9ed929865 Nov 02 15:52:57 devstack sudo[108374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:58 devstack sudo[108374]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d2a40df0-2761-4f87-b8fb-ecc6e444d2f6 tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959.1d8b2a0f-8b0a-4393-a188-b8a9ed929865" returned: 0 in 0.341s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:58 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.remotefs [None req-d2a40df0-2761-4f87-b8fb-ecc6e444d2f6 tempest-ProjectMemberTests-784856624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86703) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 02 15:52:58 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbbe059f-46fe-4324-9a3f-27f6bf00903f]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:52:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d2a40df0-2761-4f87-b8fb-ecc6e444d2f6 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:58 devstack sudo[108379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959 Nov 02 15:52:58 devstack sudo[108379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:58 devstack sudo[108379]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d2a40df0-2761-4f87-b8fb-ecc6e444d2f6 tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959" returned: 0 in 0.339s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d2a40df0-2761-4f87-b8fb-ecc6e444d2f6 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959.1d8b2a0f-8b0a-4393-a188-b8a9ed929865 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:58 devstack sudo[108384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959.1d8b2a0f-8b0a-4393-a188-b8a9ed929865 Nov 02 15:52:58 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:58 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d2a40df0-2761-4f87-b8fb-ecc6e444d2f6 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959.1d8b2a0f-8b0a-4393-a188-b8a9ed929865" returned: 0 in 0.319s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:58 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d2a40df0-2761-4f87-b8fb-ecc6e444d2f6 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959.1d8b2a0f-8b0a-4393-a188-b8a9ed929865 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:52:58 devstack sudo[108390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959.1d8b2a0f-8b0a-4393-a188-b8a9ed929865 Nov 02 15:52:58 devstack sudo[108390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:52:59 devstack sudo[108390]: pam_unix(sudo:session): session closed for user root Nov 02 15:52:59 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-d2a40df0-2761-4f87-b8fb-ecc6e444d2f6 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959.1d8b2a0f-8b0a-4393-a188-b8a9ed929865" returned: 0 in 0.249s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:52:59 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d2a40df0-2761-4f87-b8fb-ecc6e444d2f6 tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-1d8b2a0f-8b0a-4393-a188-b8a9ed929865" released by "_delete_snapshot" :: held 1.336s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:59 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d2a40df0-2761-4f87-b8fb-ecc6e444d2f6 tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-e74df1ed-dc60-4f8d-91e3-7ce67c87f959" released by "delete_snapshot" :: held 1.357s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:59 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-d2a40df0-2761-4f87-b8fb-ecc6e444d2f6 tempest-ProjectMemberTests-784856624 None] Created reservations ['4d4f7440-baea-4396-a647-406e8620d1cc', 'ba63709e-b0dc-4e96-9805-c2749b84b0cb', 'a1707031-2f6a-439b-96ec-488be030dca3', 'e77caca6-884f-4220-950c-d3c3bcefe9b7'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:52:59 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-d2a40df0-2761-4f87-b8fb-ecc6e444d2f6 tempest-ProjectMemberTests-784856624 None] Delete snapshot completed successfully. Nov 02 15:52:59 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-d2a40df0-2761-4f87-b8fb-ecc6e444d2f6 tempest-ProjectMemberTests-784856624 None] Lock "cinder-1d8b2a0f-8b0a-4393-a188-b8a9ed929865-delete_snapshot" released by "delete_snapshot" :: held 1.477s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:52:59 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-606dcb73-3f28-4927-b80d-408f4916ced5 tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-e74df1ed-dc60-4f8d-91e3-7ce67c87f959-delete_volume" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:59 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-606dcb73-3f28-4927-b80d-408f4916ced5 tempest-ProjectMemberTests-784856624 None] Lock "cinder-e74df1ed-dc60-4f8d-91e3-7ce67c87f959-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:52:59 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-606dcb73-3f28-4927-b80d-408f4916ced5 tempest-ProjectMemberTests-784856624 None] Acquiring lock "cinder-quobyte-e74df1ed-dc60-4f8d-91e3-7ce67c87f959" by "delete_volume" {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 02 15:52:59 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-606dcb73-3f28-4927-b80d-408f4916ced5 tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-e74df1ed-dc60-4f8d-91e3-7ce67c87f959" acquired by "delete_volume" :: waited 0.013s {{(pid=86703) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 02 15:53:00 devstack cinder-volume[86703]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c2e855-cefe-45c7-9057-f3c85bf8d7de]: (4, 'qcow2') {{(pid=87976) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 02 15:53:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-606dcb73-3f28-4927-b80d-408f4916ced5 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:53:00 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959 Nov 02 15:53:00 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:53:00 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Nov 02 15:53:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-606dcb73-3f28-4927-b80d-408f4916ced5 tempest-ProjectMemberTests-784856624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959" returned: 0 in 0.349s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:53:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-606dcb73-3f28-4927-b80d-408f4916ced5 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:53:00 devstack sudo[108398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959 Nov 02 15:53:00 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:53:00 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root Nov 02 15:53:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-606dcb73-3f28-4927-b80d-408f4916ced5 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0/volume-e74df1ed-dc60-4f8d-91e3-7ce67c87f959" returned: 0 in 0.233s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:53:00 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-606dcb73-3f28-4927-b80d-408f4916ced5 tempest-ProjectMemberTests-784856624 None] Lock "cinder-quobyte-e74df1ed-dc60-4f8d-91e3-7ce67c87f959" released by "delete_volume" :: held 0.637s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:53:00 devstack cinder-volume[86703]: DEBUG cinder.quota [None req-606dcb73-3f28-4927-b80d-408f4916ced5 tempest-ProjectMemberTests-784856624 None] Created reservations ['3ec4f0a3-9fbe-4cb8-bffd-0d0883e4f18a', '94e17833-f165-4581-8687-71fc2d015444', '564d9890-c3ad-498f-bcfc-f8df4d849fcb', 'b90c5595-f658-48fe-8c4c-04a4f184450d'] {{(pid=86703) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 02 15:53:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-606dcb73-3f28-4927-b80d-408f4916ced5 tempest-ProjectMemberTests-784856624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:53:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-606dcb73-3f28-4927-b80d-408f4916ced5 tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:53:00 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-606dcb73-3f28-4927-b80d-408f4916ced5 tempest-ProjectMemberTests-784856624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:53:00 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-606dcb73-3f28-4927-b80d-408f4916ced5 tempest-ProjectMemberTests-784856624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:53:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-606dcb73-3f28-4927-b80d-408f4916ced5 tempest-ProjectMemberTests-784856624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:53:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-606dcb73-3f28-4927-b80d-408f4916ced5 tempest-ProjectMemberTests-784856624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:53:00 devstack sudo[108401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:53:00 devstack sudo[108401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:53:00 devstack sudo[108401]: pam_unix(sudo:session): session closed for user root Nov 02 15:53:00 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-606dcb73-3f28-4927-b80d-408f4916ced5 tempest-ProjectMemberTests-784856624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.251s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:53:00 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-606dcb73-3f28-4927-b80d-408f4916ced5 tempest-ProjectMemberTests-784856624 None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:53:00 devstack cinder-volume[86703]: INFO cinder.volume.manager [None req-606dcb73-3f28-4927-b80d-408f4916ced5 tempest-ProjectMemberTests-784856624 None] Deleted volume successfully. Nov 02 15:53:01 devstack cinder-volume[86703]: DEBUG cinder.coordination [None req-606dcb73-3f28-4927-b80d-408f4916ced5 tempest-ProjectMemberTests-784856624 None] Lock "cinder-e74df1ed-dc60-4f8d-91e3-7ce67c87f959-delete_volume" released by "delete_volume" :: held 1.096s {{(pid=86703) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 02 15:53:10 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=83,cinder:UPDATE=112,cinder:INSERT=32,cinder:DELETE=8 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:53:10 devstack cinder-volume[86703]: DEBUG dbcounter [-] [86703] Writing DB stats cinder:SELECT=84,cinder:UPDATE=103,cinder:DELETE=10,cinder:INSERT=28 {{(pid=86703) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 02 15:53:20 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:53:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 02 15:53:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 02 15:53:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478': None} {{(pid=86703) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 02 15:53:20 devstack cinder-volume[86703]: DEBUG cinder.volume.drivers.quobyte [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5d85c85a-fe82-4940-8acf-98e6249b3478'] {{(pid=86703) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 02 15:53:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.lockutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86703) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 02 15:53:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 02 15:53:20 devstack sudo[108636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0 Nov 02 15:53:20 devstack sudo[108636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 02 15:53:20 devstack sudo[108636]: pam_unix(sudo:session): session closed for user root Nov 02 15:53:20 devstack cinder-volume[86703]: DEBUG oslo_concurrency.processutils [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/90f99b0502db3b9955262b77cd29b1d0" returned: 0 in 0.256s {{(pid=86703) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 02 15:53:20 devstack cinder-volume[86703]: DEBUG cinder.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Notifying Schedulers of capabilities ... {{(pid=86703) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 02 15:53:20 devstack cinder-volume[86703]: DEBUG oslo_service.periodic_task [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] Running periodic task VolumeManager._thread_info {{(pid=86703) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 02 15:53:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread count: 29 {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 02 15:53:20 devstack cinder-volume[86703]: DEBUG cinder.volume.manager [None req-9cfbf865-6e22-46ec-b6d2-cf2349da10af None None] thread info: [<_MainThread(MainThread, started 125876361756800)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86703) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}